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POINTWISE SECOND-ORDER NECESSARY CONDITIONS FOR 
STOCHASTIC OPTIMAL CONTROLS, PART II: THE GENERAL 

CASE* 
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Abstract. This paper is the second part of our series of work to establish pointwise second-order 
necessary conditions for stochastic optimal controls. In this part, we consider the general cases, i.e., 
the control region is allowed to be nonconvex, and the control variable enters into both the drift and 
the diffusion terms of the control systems. By introducing four variational equations and four adjoint 
equations, we obtain the desired necessary conditions for stochastic singular optimal controls in the 
sense of Pontryagin-type maximum principle. 
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1. Introduction. Let T > 0 and (fl, F, P) be a complete filtered probability 
space (satisfying the usual conditions), on which a 1-dimensional standard Wiener 
process W{-) is defined such that F = {Pt}o<t<T is the natural filtration generated 
by W{-) (augmented by all of the P-null sets). 

We consider the following controlled stochastic differential equation 

dx{t) = 6(t, x{t),u{t))dt + x{t), u{t))dW(t), t G [0, T], 

a:(0) = xo, 

with a cost functional 

(1.2) J(u(-))=E 

Here it(-) is the control variable valued in a set U C R™ (for some m G N), x{-) is 
the state variable with values in R", and 6, cr : fl x [0, T] x R" x U ^ R" (for some 
n G N), / : H X [0,T] X R” x [/ —>■ R and h : ft x R” —>■ R are given functions 
(satisfying some conditions to be given later). As usual, for maps (fi = b, cr, /, denote 
by ipxiuj,t,x,u), (Pa:x{uj,t,x,u), X ,u) and ip^^^^{uj,t,x,u) its first, second, 

third and forth order partial derivatives with respect to the variable x at (w,t,a;,u), 
respectively. And, when the context is clear, we omit the a;(G H) argument in the 
defined functions. 

Denote by B{X) the Borel tr-field of a metric space A, and by Uad the set of 
P® S([0, T])-measurable and F-adapted stochastic processes valued in U. Any it(-) G 
I4ad is called an admissible control. The stochastic optimal control problem considered 
in this paper is to find a control u{-) G Had such that 

(1.3) inf J(m(-))- 


f{t, x{t),u{t))dt -I- h{x{T)) 
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Any m(-) € Uad satisfying (1.3) is called an optimal control. The corresponding state 
x{-){= x{--,Xq,u{-))) to (1.1) is called an optimal state, and {x{-),u{-)) is called an 
optimal pair. 

One of the central problems in stochastic control theory is to derive necessary con¬ 
ditions for the optimal pair {x{-),u{-)). Before analyzing this issue in detail, we recall 
first some elementary facts from the classical calculus. Let us consider a minimizer 
xo(€ G) of a smooth function /(•) defined on a set G C K", i.e., xq satisfies 

(1.4) f{xo)=mif{x). 

xGG 


If a nonzero vector i G R" is admissible (i.e., there is a (5 > 0 so that xg + s£ G G for 
any s G [0, ^]), then one has the following first-order necessary condition: 


(1.5) 


0 < 


lim 

s—>-0+ 


f(xo + s£) - f(xo) 


= {fxixo),£). 


When {fx{xo),£) = 0 holds, i.e., (1.5) degenerates, then one can obtain further a 
second-order necessary condition as follows: 


( 1 . 6 ) 


0 < 2 lim 

s—>0+ 


f{xo + s£) - f{xo) 


{fxx{xg)£J). 


In the particular case that G is convex, by (1.5), one has 


(1.7) 


< {fx{xg),X - Xg), \/xGG. 


When fx{xg) = 0, then it follows from (1.6) that 


(1.8) Q < {fxx{xg){x - Xg),X - Xg), V X € G. 

Clearly, compared to the first-order necessary condition (1.5)/(1.7), the second-order 
necessary condition (1.6)/(1.8) can be used to single out the possible minimizer xg 
from a smaller subset of G. From the above analysis on the minimization problem 
(1.4), it is easy to see the following: 

1) Usually, one has to impose more regularity on the data (say G^ for /(•)) for 
the second-order necessary condition than that for the first-order (for which 
G^ for /(•) is enough); 

2) The derivation of the second-order necessary condition is probably more com¬ 
plicated than that of the first-order situation; 

3) Usually, in order to establish the second-order necessary condition, one needs 
to assume that the first-order condition degenerates in some sense. 

Very similar phenomenons happen when one establishes the optimality conditions for 
optimal control problems, though generally it turns out to be much more difficult 
than that for the above minimization problem. 

For the moment, let us return to the deterministic optimal control problem, i.e., 
the functions cr(-) = 0, 6(-), /(•), h(-), x{-) and u{-) in (1.1)-(1.2) are independent 
of the sample point uj. Let '0(-) be the solution to the following ordinary differential 
equation. 


(1.9) 


= -bx{t, x{t), + fx{t, x{t), u{t)), t G [0, T] 

V;(r) = -hx{x{T)). 
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H{t, X, u, ijj) := {ip, b{t, X, u)) — f{t, X, u), V {t, x, u, ip) G [0, T] x R” x 17 x R". 
Then the following Pontryagin maximum principle ([23]) holds 

(1.10) H{t,x{t),u{t),ip{t)) = m.axH{t,x{t),v,ip{t)), a.e. t G [0,T]. 

veil 

The maximum condition (1.10) is a first-order necessary condition for optimal controls. 
Suppose that, for a.e. t G [0,r] the maximization problem (1.10) admits a unique 
solution and the optimal control u{-) can be represented as a function T(-, •, •) of t, 
x{t) and ip{t), i.e., u{t) = T{t,x{t),ip{t)) satisfies 

(1.11) H{t,x{t),T{t,x{t),ip{t)),ip{t)) = u].axH{t,x{t),v,ip{t)), a.e. t G [0,T]. 

v^U 


Then, substituting T into the control system (1.1) (with cr = 0) and the adjoint 
equation (1.9), we obtain the following two-point boundary-value problem: 


( 1 . 12 ) 


x{t) = H^{t,x{t),T{t,x{t),ip{t)),ip{t)), tG[0,T], 

< ip{t) =-Ha:{t,x{t),T{t,x{t),ip{t)),ip{t)), tG[0,T], 

^ x{0)=Xo, 1 p{T) = -ha:{x{T)). 


If both the original optimal control problem and the two-point boundary-value prob¬ 
lem (1.12) admit unique solutions, then u{-) = T{-,x{-),ip{-)) is the solution to the 
original optimal control problem (1.3) where {x{-),ip{-)) is the solution to (1.12). It is 
easy to see that, the uniqueness of the solution to the maximization problem (1.10) (in 
the first-order necessary condition) plays an important role to reformulate the origi¬ 
nal optimal control problem into the two-point boundary-value problem (1.12). When 
this maximization problem admits multi-solutions, the first-order necessary condition 
is not enough to determine the optimal controls. Indeed, in this cases, the solution 
map for the maximization problem becomes a set-valued map. When substituting this 
set-valued map into the control system and the adjoint equation, one obtains a differ¬ 
ential inclusion problem, which is usually very hard to solve. When this happens, as 
in the classical calculus, it is quite useful to analyze further the second-order (or even 
higher-order) necessary conditions for optimal controls. In the case of deterministic 
control problems (even in finite dimensions), there are many works devoted to this 
topic (See [4, 9, 10, 12, 14, 17, 21, 25] and the rich references therein), especially one 
can find several interesting monographs ([1, 6, 11, 15]) in this direction. 

Naturally, one expects to establish the stochastic maximum principle for the op¬ 
timal control problem (1.3). We refer to [2, 3, 13, 16] and references cited therein for 
some early works in this respect. Since in this case the ltd integral appears in the 
control system (1.1), things became much complicated. First, quite different from the 
equation (1.9), the adjoint equations in the stochastic cases (called backward stochas¬ 
tic differential equations, BSDEs for short) have two unknowns. Second, when the 
control region is nonconvex, the needle variation, which is essential a perturbation 
of the optimal control on a measurable set with small measure, is used to derive the 
optimality conditions. When the diffusion term a contains the control variable u, the 
state increment is an infinitesimal of order 1/2 with respect to e (e —0“'') (when the 
optimal control is perturbed with respect to the time variable on a measurable set 
with Lebesgue measure e). Therefore, to obtain the first-order necessary condition 
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for optimal controls for the general case, the cost functional needs to be expanded up 
to the second order, and two variational equations and two adjoint equations need to 
be introduced (See [22]). More precisely, define the Hamiltonian Ti, by 

^ V (w,t,a;,u,yi,0i) G H X [0,T] X R" X 17 X M" X R". 


Let (pi(-)i 9i(')) (p2(-)) 92(-)) be respectively solutions to the following first- and 

second-order adjoint equations, 


(1.14) 

and 


(1.15) 


dpi{t) = 

Pi{T) = - 

dp2it) = 
P2{T) = - 


bxitypiit) + ax{t)'^qiit) - fxit) dt + qi{t)dW{t), tG[0,T], 

hx{x{T)) 

bx[tYp2{t) + P2{t)hx{t) + OxitY P2{t)Ux{t) + (Tx{tY q2{t) 

+q2{t)ax{t)+ 'Hxx{t) dt + q2{t)dW{t), tG[0,r], 

hxx{x{T)), 


where bx{t) = b^{t, x{t), u{t)), ax{t)=ax{t, x{t), u{t)), f^{t) = fx{t, x{t), u{t)), 'Hxx{t) = 
'Hxx(t,x(t),u{t),pi(t),qi{t)). The following first-order necessary condition for the 
optimal pair (x(-),u(-)) is established in [22]: 

(1.16) IHI(t, a:(<), u) <0, V u G [/, a.e. (oj,t) G H x [0,T]. 


where 

]HI(w, t, X, u) 

= H(w, t, X, u,pi{t),qi{t)) - 'H{w, t, X, u{t),pi{t),qi{t)) 

+ 5 {p 2 {t) (cr(w, t, X, u) — a{u}, t, X, u{t ))), a{uj, t, x, u) — ct(w, t, x, u{t))) , 

{uj,t,x,u) G H X [0,T] X R” X U. 

Similar to the above, if the optimal control u{-) can be represented as a function 
'!'(•, •, •, •, •, •) of (w, t, x,pi, gi, P 2 ) using the condition (1.16) (i.e., u{ui, t) = 4>(a;, t, x{t), 
Pi{t), qi{t),p 2 {t))) (Note that g 2 does not appear explicitly in the definition of H), 
then the optimal control problem can be closely related to the following fully coupled 
forward backward stochastic differential equation (FBSDE, in short): 


dx{t) = b{t)dt + d{t)dW{t), tG[0,T], 


dpi{t) = - 

dp2{t) = - 


bx[tyPi{t) + dx{tYqi[t) - fx:(t) dt + qi{t)dW{t), fG[0,r], 
bx(tVp2{t) +P2{t)bx{t) + dxitY P2{t)ax{t) +ax{tYq2{t) 
+q2{t)dx{t) +'Hxx{t) dt + q 2 {t)dW{t), tG[0,r], 

. a:(0) = xo, Pi{T) = -hx{x{T)), P 2 {T) = -hxx{x{T)). 


(1.17) _ 

where b{t) = b(t,x{t),^{t,x{t),pi{t),qi{t),p 2 {t))), a{t) = cr(t, x(t), 4'(f, x(t), pi{t), 
qi{t),p 2 {t))), iixx{t)='Hxx{t,x{t),^{t,x{t),pi{t),qi{t),p 2 {t)), similar for bx{t), cFx{t), 
and fx{t). For some more discussions about FBSDEs, we refer to [18]. 
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However, exactly as the deterministic case, the first-order necessary condition is 
not always effectively to find the stochastic optimal controls. In the preceding dis¬ 
cussion, the uniqueness of the solution to (1-16) plays an important role to reduce 
the original optimal control problem to the FBSDE (1.17). When the problem (1.16) 
admits multi-solutions, one needs to establish suitable second-order necessary condi¬ 
tion for optimal controls as an effective supplement to the first-order condition. As 
we mentioned before, there exist many works addressing to the corresponding deter¬ 
ministic problems. However, in the stochastic setting, there are only two articles [5] 
and [24] available before our work [28]. When the diffusion terms do not contain the 
control variable, Tang [24] derived a pointwise second-order maximum principle for 
stochastic optimal controls, for which the control regions are allowed to be nonconvex. 
When the diffusion terms contain the control variable, Bonnans and Silva [5] estab¬ 
lished some integral-type (rather than pointwise) second-order necessary conditions 
for stochastic optimal controls with convex control constrains. In [28], we found that, 
quite different from the deterministic setting, there exist some essential difficulties 
in deriving the pointwise second-order necessary condition from an integral-type one 
whenever the diffusion terms contain the control variable, even for the special case 
of convex control constraints, and obtained a positive result for this case under some 
assumptions in terms of the Malliavin calculus. 

The main purpose of this paper is to establish some pointwise second-order nec¬ 
essary conditions for stochastic optimal controls in the general cases, i.e., the control 
regions are allowed to be nonconvex and both the drift and diffusion terms contain 
the control variable. Stimulated by [22], it is easy to see that, in order to obtain 
the second-order optimality condition for the general case, one needs to expand the 
cost functional up to the forth order, and introduce four variational equations and 
four adjoint equations. This is the main difference between the present paper and the 
previous related works (i.e., [5, 24, 28]). On the other hand, the solutions of the vari¬ 
ational equations appear in the second-order terms (in the sense of the perturbation 
measure) of the variational formulation with respect to the optimal controls, and it 
seems to us that, they cannot be eliminated by introducing new adjoint equations. 
When the diffusion terms of the control systems contain the control variables, similar 
to the convex control constraint cases, the Lebesgue differentiation theorem cannot 
be used directly to derive the pointwise second-order necessary condition from the 
variational formulation (See [28, Subsection 3.2] for a detailed explanation). This is 
another difference between this paper and [24] addressing to the case of the diffusion 
term independent of the control variable. In this paper, first we establish a variational 
formulation of (1.3) with respect to the optimal controls. Then, using this variational 
formulation and the martingale representation theorem, we derive a second-order nec¬ 
essary condition for stochastic optimal controls. Further, under some conditions, we 
refine this result and obtain a pointwise second-order necessary condition. Note that 
the analysis in this paper is much complicated than that in [28] though some of the 
ideas and techniques are the same in these two papers. 

The rest of this paper is organized as follows. In Section 2, we collect some 
notation and concepts. In Section 3, we introduce the related variational equations 
and adjoint equations. In Section 4, we state the main results of this paper and present 
some remarks and examples. Section 5 is devoted to proving our main results. Finally, 
the proofs of two technical results are given in Appendixes A and B, respectively. 

Partial results in this paper have been announced in [27] without proofs. 
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2. Preliminaries. Let m, n, d, h, I € N. Denote by (•,•) and | • | respectively 
the inner product and norm in M" or K™, which can be identified from the con¬ 
texts. For any a,/3 € [l,-|-oo), denote by the space of J^T-measurable 

random variables ^ such that E < -too, by L^(fl x [OjT];®”) the space of 
0 ^([0, T])-measurable processes (p such that \\p\\i 3 := [E \p{t)\^dt\'^ < +cx), 
by Lp(n;L“(0,T;R”)) the space of 0 S([0, T])-measurable, F-adapted processes tp 

such that ||(/?|U ,/3 := [lE < -too, by Lp(0; C([0, T]; R")) the space 

of J" ® i3([0, T])-measurable, F-adapted continuous processes (p such that ||v?||oo ,/3 := 

[E (suptg[Q 7 ^] ^ < -boo, by x [0, T]; R”) the space of J" ® S([0, T])- 

measurable processes (p such that Hv^Hoo := ess sup^,^ |(/5(a;, t)| < +oo, and 

by L^(0,T;Lp(n x [0,T];R”)) the T x [0,T]) measurable maps tp such that 

for any t £ [0,T], p{-,t) is F-adapted and ||v ?||/3 := [E/q^/q^ \p{s,t)\^dsdt\ ^ < -|-oo. 

Let C L^^(n;]R”) be the space of Malliavin differentiable random vari¬ 
ables, and for any ^ G denote by V.^ its Malliavin derivative. Denote by 

L^’^(R”) the subspace of L^(fl x [0, T]; R”)) whose elements satisfy the following con¬ 
ditions. 

(i) For almost every t G [0,T], p{t, •) G I])^’^(R”), 

(ii) (w, t, s) -£■ Dsp{t, uj) admits an 0 S([0, T] x [0, T])-measurable version, and 

(iii) lll<b>llli .2 := [E/o^ \p{t)\^ dt + E \Dspit)\^dsdt]^ < -boo, 

where 'D.pit, ■) is the Malliavin derivative of the random variable •). Denote by 
L 2 '^(R") the subspace of L^(flx [0, T]; R")) whose elements are Malliavin differentiable 
almost everywhere and their Malliavin derivatives have suitable continuity. More 
precisely, write 


L^V^(R"):= {(/?(•) G L1'2(R") 3 V+(/?(•) G x [0,T];R”) such that 

/e(s) := sup E — V“''i,5(s)|^ < -boo, a.e. s G [0,T], 

s<t<{s-\-e)AT 

/e(-) is measurable on [0,T] for any e > 0, and lim / /e(s)ds = 01, 

E-*-o+ Jo ^ 

L^L^(R'^):= |(^(.) g 3 V-p{-) G L^(D x [0,r];R”) such that 

ge{s) := sup E \'Dsp{t) — V“(/?(s)|^ < -boo, a.e. s G [0,T], 

{s—e)\/0<t<s 

ge{') is measurable on [0,T] for any e > 0, and lim / gAs)ds = 0 >. 

£^0+ Jo ^ 


Denote L 2 ’^(R") = L 2 +(R”) nL 2 !^(R”). For any </?(•) G L 2 ’^(R"), denote Vp{-) = 
V+(/5(-) -b V~p{-). When p is F-adapted, Vsp{t) = 0 for any t < s. In this case, 
Vp{-) = V+V3(-). Denote by L 2 p(R”) the set of all F-adapted 
processes in L 2 (R”). We refer to [20] for more materials on this topic. 

Denote by LinR"; R"*) the d-linear maps from R” x ... x R” to R'". Let {ei,..., 

d '' -V-' 

d 

Bn} be the standard basis of R", {zi,... ,Cm} be the standard basis of R'”. Any A in 
L(nR";R™) is uniquely determined by the numbers 

d 


x^i 


■,3 d — 


(A(ejj,..., ti) 


1 = 1 ,.. 


m, Jfc = l,...,n, fc= 1,...,J. 
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We define the norm of A by 


|A| := 


E .") 


2 


1 

2 


Let r £ and 0 £ We denote by AoL the composition of A 

h l i 

with r at the zth position (i = 1, • • •, d), i.e., 


Aor(a:i,.. .,Xd+h-i) = A(a;i,... ,r(a:i,.. .,Xi+h-i), ■ ■ .,Xd+h-i), 

t i 

ccfe € R", fc = 1,... 1, 


and we denote by A o (F, 0) the composition of A with F and 0 at the ith and the 
ij 

jth positions (i ^ j, = i.e., 

A o (F, 0)(a;i,.. .,Xd+h+i- 2 ) 

— A(xi , . . . , F(^2 ; • ■ • 1 ^i+h—1 );•■•; 0(^J+/l —1: ■ • ■ ; ^j + h + l — 2 );■•■; ^d+h+l — 2 '): 
i 3 

a:fc G M", k = 1 ,... ,d+h+l — 2 . 


In a similar way, if y, z G R", we denote 
A»y(xi,... ,a;d-i) = A(a;i,... , 2 /,... ,a;d-i), a:fc G R”, fc = l,...,d-l, 

i i 

A • (y, 2)(xi,.. .,Xd-2) = A(xi,... , 2 /,... ,2;,.. .,Xd-2), Xk G R”, fc = l,.. .,d- 2 . 

i 3 


Denote by L^(0, T; A(nR"; R)) the space of J" (8) S([0, T])/S(L(nR"; R))- 

d d 

measurable processes ip such that ||(/3||i,2 := [R (/p^ |(/3(t)|dt)^ < +oo and by 
Lp(r2; A^(0, T; L(nR";R)) the space of 0 S([0, T])/S(L(nR"; R))-measurable pro- 

d d 


— 

cesses (p such that ||i ^||2 := [E Jp \(p{t)\'^dt] ^ < -boo. We give below an Ito formula 
for multi-linear function-valued stochastic processes, which is an easy extension of the 
classical Ito formula (Hence we omit its proof). 

Lemma 2.1. Let P{-) be an L(nR";R)-r'a^Mec? process of the form 

d 


P{t) = Po+ [ A{s)ds+ [ B{s)dW{s), tG[0,r] 

Jo Jo 

where A{-) G L^(D; 1.1(0, T; L(nR”; R)), B{-) G L2(D; L2(0, T; L(nR”; R)), and let 

d d 

x{-) he an "EA-valued process such that 

x{t)=xo+f f{s)ds-\- f g{s)dW{s), tG[0,r], 

Jo Jo 

where /(•) G Lp(r2; 1.1(0, T;R"), y(-) G i.p(D; L^(0, T; R”). Then the following ltd 
formula holds. 

PiT){x{T),...,xiT))-Po{xo,...,xo) 
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f [’/W’• ■ • ’2^(0) + Mt)...,x{t)) 

•^0 i=l * 

d 

+ '^B{t) (x(i), ...,g{t),..., x{t)) 


d d 


dt 


( 2 . 1 ) 


+EE P{t) {x{t),..., g{t),..., g{t),..., x{t)) 

i=i j=i+i * 1 

B{t) {x{t),..., x{t)) + P{t) {x{t ),..., g{t ),..., x{t)) dW {t). 


i=l 


3. Variational formulations. In this section, we establish a second-order (with 
respect to the perturbation measure) Taylor expansion of the cost function at the 
optimal control m(-). Firstly, we recall some known estimates for stochastic differential 
equations. 

Lemma 3.1. ([19, Proposition 2.1]) Suppose that there exists a constant L > 0 
such that for ip = b, a and any x, x G M", u GU , 

- , J \p{t,x,u) — p{t,x,u)\ < L\x — x\, a.s. a.e. t g[0,T], 

( j(p(t, 0,u)| < L, a.s. a.e. t £ [0,T]. 

Then for any /3 > 1, u{-) G Uad CLnd initial datum Xq G M”, the state equation 
(1.1) admits a unique solution x{-) G Lp(r2; C([0; r];K”)), and for some constant 
C = C{f3, L,T) > 0 the following estimate holds: 


E 


sup |a;(s)|^ 
'-se[o,t] 


(3.2) < CE 


\xof + (^J \b{s,0,u{s))\dsy + (^J \a{s,0,u{s))\'^dsy 


Further, if x{-) is the unique solution corresponding to (xo,u(-)) G K” x Idad, then 


E 


sup |a;(s) — a;(s)|^ 

'-sG[0,t] 


< CE 


(3.3) 


[a^o - a;o|^ ”*” (y “ b{s,x{s),u{s))\ds'^ 

-l-^y |(t(s, a;(s),u(s)) — tT(s,a;(s),?l(s))|^ds^ 


In what follows, we assume that 
(Cl) The control region U C K™ is nonempty and bounded. 

(C2) Functions b, a, /, and h satisfy 

(i) For any {x,u) £ R" x t/, the stochastic processes b{-,x,u) : [0,T] x 
n -G- R”, cf{-,x,u) : n X [0,T] ^ R” and fi-,x,u) : 11 x [0,T] ^ R 
are P ® S([0, T])-measurable and F-adapted. h{x, •) : 11 —>■ R is Pt- 
measurable. 
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(ii) For almost all {uj,t) G ft x [0,T] and any u G U, the map x !—>■ 

f{u!,t,x,u)) is continuously differentiable up 
to the forth order, and there exist a constant L > 0 and a modulus 
of continuity ui : [0, oo) ^ [0, oo) such that for a.e. G ft x [0,r], 

and all x, x G M”, u, u G U, (p = b, a, /, 

0, 0)1 < L, \ip(t, X, u) — (p{t, ai, m)! < L\x — x\ + (jj{\u — u\), 

X, u) - (fixit, {i)| < L\x -x\+ w(|u - u|), 

< \(pxxit, X, u) - (Pxx{t, x,u)\ < L\x - x| + ui{\u - m|), 

\(Pxxx{t,X,u) - ipxxx{t,X,u)\ < L\x - x\ +uj{\u - u|), 

\Pxxxxit, X, u) - (fixxxxit, I, w)| < L\x - i| + Uj{\u - u\). 

(hi) h{-) is continuously differentiable up to the forth order (a.s.), and there 
exists a constant L > 0 such that for any x G M", 

|h(a;)| < L(1 + \hx{x)\ < L{1 + |a;|^), 

|^a:a;(a^)| ^ “h 1^1 ); ^ ^/(l | (a^) | ^ -b, Q.S. 

Obviously, for p = b, a, /, when (C1)-(C2) are satisfied, for a.e. (w,t) G ft x [0,T], 

1^3: (^5 a^5'^) I “t“ I (^7 a^j’^) I “f \Pxxx(t^ “1“ IPxxxxitj "G Z/, 


for all (x, u) G K” x U, and the controlled stochastic differential equation (1.1) admits 
a unique solution for any u{-) G Uad and the cost functional is well-defined. 

Let (a;(-), u{-)) be an optimal pair, u{-) G Uad be an admissible control, C [0, T] 
be a measurable set with measure \Es;\ = e for a given e G (0,r). Define 


u%t) = 


u{t), 

u{t), 


t G Eg, 

tG[0,T]\Eg. 


Let x®(-) be the state with respect to the control m'^(-) and let Sx{-) = x®(-) — x(-). 
For (p = b, a, /, write px{t) = Pxit, x{t),u{t)), - ^XX (t, x(t), u(t)), Pxxxit) — 

Pxxxit,x{t),u{t)), Pxxxxit) = Pxxxxit,x{t),u{t)), and put 


Sp{t) = p{t, x{t), u{t)) - p{t, x{t), u{t)), 

Spx{t) = Px{t, x{t), u{t)) - Px{t, x{t), u{t)), 

Spxx{t) = Pxx{t,x(t),u{t)) - Pxx{t,x(t),u{t)), 
5pxxx{t) = Pxxx{t, x{t),u{t)) - Pxxxit, x{t), u(t)). 


Now, we introduce the following four variational equations: 


(3.4) 


dyl{t) = bx{t)yl{t)dt 

ym = 0 ; 


<Xx{t)yi{t) + Sa{t)xEAt) dW[t), 


tG[Q,T], 


dy^it) = bxit)y^{t) + lbxx{,t){yl{t),yl{t)) + Sb{t)xEAt) dt 
^x{t)y^{t) + ^crxx{t){yl{t),yl{t)) 

+Saxit)yl(t)xEAt) dW{t), tG[0,T], 

2/2(0) = 0; 


(3.5) 
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(3.6) 


dy^t) = {bx{t)yUt) + + 2/1(0 >2/2 W) 

+bxx{t){y^{t),yl{t))] + ^bxxxit){yl{t),yl{t),yl{t)) 

+Sbx:{t)yl{t)xE, 

+ {ctx(02/3(0 + ( 2 / 1(0 + 2/1(0 >2/1(0) 

+CT>r>a>(0(2/2(0>2/l(0)] + gcr3;^x(0(2/l(0>2/l(0>2/l(0) 

+Sax{t)y^{t)xEA't) + i^crxx(0(2/i(0>2/i(0)XiSe(0}c^W^(0> 
t€[0,T], 

2/1(0) =0; 


(3.7) 


dyUt) = {bx{t)yl{t) + I [6xx(0 ( 2 / 1(0 + 2 / 2(0 + 2 / 3 ( 0 >^1(0) 

+ 6 xx( 0 ( 2 / 3 ( 0 > 2/1 (0 +2/2(0)] + (2/1(0 >2/1 ( 0 > 2 / 1 ( 0 ) 

+bxxx (0 (2/1 (0 > 2/2 (0 > 2/1 ( 0 ) + (0 (2/2 (0 > 2/1 (0 > 2/1 ( 0 ) 

+/ixxx (0 (yf (0 > 2/2 (0 > 2/2 ( 0 ) + (0 (2/2 (0 > 2/2 (0 > 2/1 ( 0 ) 

+&XXX (0 (yl (0 > yf (0 > yf (0) + (0 (yl (0 > yi (0 > yf (0) ] 

+^ &XXXX (0 (yf (0 > yf (0 > yi (0 > yf (0) 

+5b^{t)y^{t)xEA't) + i<5^>i>x(0(yf(0>yf(^))xBO0}c/i 

+ {o-x(0y4(0 + ^[<^xx{t){yi{t) + y^{t) + y^{t),yl{t)) 

+<yxx{t){yUt),yiit) + yUt))] + kWxxx{t){yl{t),yf{t),y^{t)) 

+(Txxx (0 (yf (0 > yf (0 > yf (0) + o-^xx (0 (yf (0 > yf (0 > yf (0) 
+cixxx (0 (yf (0 > yf (0 > yf (0) + o-xxx (0 (yf (0 > yf (0 > yf (0) 
+CTxxx (0 (yf (0 > yf (i) > yf (0) + o-xxx (0 (yf (0 > yf (0 > yf (0) ] 
+j^(Txxxx (0 (yf (0 > yf (0 > yf (0 > yf (0) +d(Tx {t)yi {t)xE, (0 
+1 [^o-xx (0 (yf (0 + yf (0 > yf (0) + <5crxx (0 (yf (0 > yf (0) ] xb. (0 

+g5o-xxx(0(yf(0>yf(0>yf(0)xis00}c/M/"(0> [o,7']> 

y|(o) = 0 . 


Denote 

^(•) :=yf(-) + yf(-) + y|(-) + y|(-), 
7(-) :=yf(-) + yf(-)> 
r2{-) :=&(•)-7(-)> 
r4(-) :=fe(-)-C(-)- 


y(-) := yf(-) + y 2 (-) + y3(-)> 
ri(-) := fe(-)-yf(-)> 
r3(-) := fe(-) - y{-), 
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From (3.4)-(3.7) and Lemma 3.1, we obtain the following result. 

Lemma 3.2. Let (Cl) and (C2) hold. Then, for any /?>!,£€ (0,T), e 


0+, 


the following estimates hold: 


hiWL.p < 

\\ri\\t,^p < CeP, 

M\t,p < CeP, 

\V^\\L,p < 

hlfoo.p < 

\\ri\\t,^p < Ce2/3, 

MICp < Cs^P, 

\\rA\\t>,p < 

< ei. 



Proof. See Appendix A. □ 

Further, we obtain the following Taylor expansion for the cost functional with 
respect to the control perturbation. 

Lemma 3.3. Let (Cl) and (C2) hold. Then, 


J{u^) — J{u) 

= E [ 

Jo 


fx{t)({t) + ^fa:x{t){v{t),r]{t)) + 


1 


fxxxx{t) {yl {t) , yf (t), yl (t) , yf {t)) + Sf{t)xE, (t) 


+Sfx{t)x{t)xEAt) + 2^fx:x{t){yl{t),yl{t))xEAt) 


dt 


(3.8) 


+E 

1 

+ 6 
1 


hx{xiTmT) + -hUHT)){v{T),v{T)) 
h,UHT)){x{T),j{T),x{T)) 


+ -h,xxxixiT)){yt{T),yl{T),yliT),yliT)) + o{e^) (£ ^ 0 +). 


Proof. Similar to the proof of Lemma 3.2, we only consider the 1-dimensional 
case. By Taylor’s formulation, 

f{t,x‘^{t),u^{t)) - f{t,x{t),u{t)) 

= f(t, x%t),u{t)) - f{t, x{t), u(t)) + f{t, x{t), u^it)) - f(t, x(t),u{t)) 
+f{t,x^t),u^t)) - f{t,x(t),u%t)) - f(t,x%t),u{t)) + f(t,x{t),u{t)) 

= fxit)Sx(t) + l-fxx(t)6x{t)'^ + ^fxxx(t)Sx(tf 

2 o 

1 

+ R / S^fxxxx{t,Ox{t) + {1 - 9)x%t),u{t))Sx{t)'^d9 + Sf{t)xEAi) 

o Jo 

+ fxit,x(t),u'^{t))Sx{t) + ^fx:x{t, x{t),U%t))Sx(tf 

1 

+ 0 / S'^fxxx{t,9x{t) + {l-9)x^{t),u^t))Sx{tfd9-fx{t)6x{t) 

2 Jo 

-^fxx{t)Sx{t)'^ - \ j S‘^fxxx{t, 9x(t) + (1 - 6»)x^(t), u{t))5x{tfd9 

= fxit)Sx(t) + l-fxx(t)6x{t)'^ + ^fxxxit)Sx(tf 

2 o 

1 

+ g J d^fxxxx{t, 9x{t) -h (1 - 9)x%t),u{t))Sx{t)'^d9 
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+ Sf{t)XEAt)+^fx{t)Sx{t)xEAt) + \^fxx{t)Sx{tfxEAt) 

+ ^ J 9'^(^fxxx{t,0x{t) + {1 - 0)x^{t),U^{t)) 

-fxxx{t, 0x{t) + (1 - 0)x^{t),u{t))^ 5x{tfd0, 


h{x^T))-h{x{T)) 

= hx{x{T))Sx{T) + -hxx{x(T))5x{Tf' + -hxxx{x(T))5x{T)'^ 

2 D 

1 

+ g 0^hxxxx{9x{T) + {l-9)x%T))Sx{T)U9. 

By Lemma 3.2, 


J(u^) — J{u) 

fT" r \ \ \ 

E [fx{t)^{t) + ^fxxit)v{tf + -^fxxx{t)x{tf + —Jxxxx{t)yl{tf 

+ 5f{t)XEe{t)+Sfx{th{t)XEAt) + yfxx{t)yl{tfxEeit) dt 


+E 


+E 


+ - 


hxixiTmr) + -hxx{x{T))y{Tf 

+ ^hxxx{x{T))x{T)^ + ^hxxxx{.x{T))yl{T)'^ 
fx{t)ri{i) + ^fxx{t){Sx{tf - y{tf) + ^fxxx{t){Sx{tf - x{tf) 


pT , 


1 


0'^fxxxx{t, 0x{t) + (1 - 0)x''{t), u{t))Sx{t)^d0 - fxxxx{t)yl{t)'^ 


2r 


+Sfxit)r2{t)xEAi) + ^dfxx{t){Sx{tf - yUA^XEAt) 

+ i J 0'^(^fxxx{t,0x{t) + A - 0)xAt),uAt)) 


+E 

1 

+ 6 
1 


-fxxx{tAx{t) + (1 - 0)xAt)^U 


1 . 


^d0 


dt 


hx{x{T))rAT) + -hxx{x{T))[6x{TA - y{TA) 
hxxx{x{T)){5x{Tf -x{Tf) 


1 


+ g J 0^hxxxx{0x(T) + (1 - 0)xAT))6x{Tfd0 - —hxxxx{x{T))yATA 

j'T' r 2 ^ 2 1 

E J [fx{t)At) + -fxxit)v{tf + -fxxx{t)x{tf + ^fxxxxiAylAf 


+df{t)xEAt)+dfx{t)lit)xEAt) + ^SfxxiAyAtAxEAA 


dt 


+E 


hx{x{T))AT) + -hxx{x{T))y{Tf 
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Kx.{x{T))-f{Tf 


24 


{x{T))yl{Tf +o{e^) (e ^ 0+). 


This completes the proof of Lemma 3.3. □ 

To establish the variational formulation for the optimal control m(-), in addition 
to the adjoint equations (1.14)-(1.15), the following two adjoint equations are also 
needed: 


(3.9) 


dpz{t) = - 


Y. + Y. Y P3(i) O (o-x(t),Cra:(t)) 

k^l ^ / = 

3 2 

+ Y Q3{t)oa^{t) + ^Y (P2{t) ° bxx{t) + 92 (t) O 

fc=l k=l^ ^ 

+l{p2{t) o^{ax{t) 

: ^xx (t)) +P2(t) o^(a-xx(t),c 


~^T~Lxxxit) 


dt + qs{t)dW{t), t€[0,T], 


. Ps{T) = -hxxx{x{T))] 


and 


(3.10) < 


dpi{t) = - 


Y Pi{i)°bx{t)+ Y Y P4{.t) o (ax{t),<Tx{t)) 

/c=l Z=fe+1 

4 


+ Y q4{t)oax{t) + 2Y (p3{t)obxx{t) + qsit) o axx(,t)) 
k=i ^ fe=i ^ k / 

3 3 2 

+ 2 X! L ^3(0 ° {<7x{t),(Jxx{t)) +2 X; P2{t)obrxx{t) 


k=l 


fc=i;=i, i^k 

+ 2^P2(t) {(Xx{t),axxx{t)) +P2it) {(Jxxx{t),aa 


+3p2{t) O {<7xx(,t),axx{t)) + 2Y q2{t) o axxx{t) 

k=l ^ 

dtqi{t)dW{t), te[o,r], 


T 'blxxxx (t) 

P 4 {T) = -hxxxx{x{T)), 

where the Hamiltonian H is defined by (1.13), and 

n XXX {t) = n XXX iu;,t,x{t),u{t),pi{t),qi{t)), 
n xxxx {t) = n 

xxxx {uj,t,x(t),u{t),pi{t),qi{t)). 


By the existence and regularity results for BSDEs (see [7]), for any /3 > 1, the 
adjoint equations (3.9)-(3.10) admit unique solutions, respectively, and 


(P3(-),93(-)) € T^(B;C([0,T];L(nM”;M))) x T^(B; 2.2(0, T; L(nR"; K))), 
(p4(-),94(-)) € 4(L!;C([0,T];L(nM”;K))) x L^(B; 2.2(0, T; L(nR"; R))). 

4 4 
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Using the Taylor expansion of the cost functional established in Lemma 3.3 and 
the duality relationship between the variational equations (3.4)-(3.7) and the adjoint 
equations (1.14)-(1.15) and (3.9)-(3.10), we obtain a variational formulation for the 
cost functional. In order to short the expression of this formulation, we introduce 
some more notations. 

Let the Hamiltonian be defined by (1.13). Write 

S(a;, t, X, u, y 2 ,Z 2 ) = [2/2 • b{uj, t, x, u) + Z 2 » t, x, u) , 

k^l 

{uj,t,x,u,y 2 ,Z 2 ) enx [0,r] xW^ xU x L(nM^;E) X L(nE^;M); 

2 2 

1 ^ 

T(a;, t, X, u, 2 / 3 , ^^ 3 ) = x X] [^3 * ’ 

fc=i ^ 

{u},t,x,u,y 3 ,Z 3 ) G U X [0,r] X K” X U X L(nR";R) x L(nR”;K), 

3 3 

and denote 
§(w, t, X, u) 

= Mj;{uj,t,X,u) + S{uJ,t,X,U,P2it),q2it)) - S{uj,t,X,u(t),P2{t),q2(t)) 

+ l^[P2{t)o^(j^{uj,t,x,u{t))\ • {a{uj,t,x,u) - a{uj,t,x,u{t))) 

+ \[p^i*) ° t, X, u{t))] • (cr(w, t, X, u) - a{uj, t, X, u{t))) 

1 ^ ^ 

uu E Psit) • (^a{ui,t,x,u) — a{u;,t,x,u(t)),a{u;,t,x,u) — a-{u;,t,x,u(t))), 

” fc=i i=k+i 

T(a;, t, X, u) 

= §x( 0 J,t,X,u) + Sx( 0 J,t,X,U,p 2 (t),q 2 (t)) - Sx(uj,t,x,u(t),p 2 (t),q 2 (t)) 
+T(u;,t,x,u,p 3 (t),q 3 (t)) - T(uj,t,x,u(t),p 3 (t),q 3 (t)) 

1 2 2 

+ 2^ ^ 4 ' 2(0 Oj (f^x(w,t,x,M(<)),cra,(t,x,M)-cr,j(w,t,x,u(t))) 

k—1 l—l, l^k 
^3 3 

+ 6^ ^ [P3(i) ° (o-a;(a;,t,x,u) - cra,(w,t,x,M(t)))] 

k—1 l—l, l^k 

• (cr(w, t, X, u) — cr{ui, t, X, u{t))^ 

3 3 

xE E [p3{t) O (Ja;{uJ, t, X, u{t))] • {( 7 {uj, t, X, u) - a(uj, t, X, u{t))) 

A:—1 l—l, l^k 
1 ^ ^ 

P4{t) (cr(w, t, X, u) — a{u!, t, X, u{t)), 

k=l l=k+l 

(j{ui, t, X, u) — a{ui, t, X, u{t ))), 

{uj,t,x,u) G U X [0, T] X K" X U, 

where, (pi(-)i 9i(’)) {P 2 {-),q 2 {-)) are respectively the solutions to (1.14) and (1.15), 

{P 3 {‘),Q 3 {')) and (p 4 (-), ( 74 (-)) are respectively the solutions to (3.9) and (3.10). 
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We have the following variational formulation for the cost functional. 
Proposition 3.4. Let (Cl) and (C2) hold. Then, 


J{u^-)) - J{u{-)) 


(3.11) 


+ 7 ; {^it,x{t),u{t))yl{t),yl{t))]xEAt)dt + {e 0+). 


Proof. See Appendix B. □ 

4. Second-order necessary conditions. In this section, we establish some 
second-order necessary conditions for stochastic singular optimal controls in the sense 
of Pontryagin-type maximum principle. Firstly, we introduce the concept of the sin¬ 
gular control (The corresponding concept for deterministic control systems can be 
found in [10] and the references cited therein). 

Definition 4.1. An admissible control u{-) is called a singular control in the 
sense of Pontryagin-type maximum principle on a control region V, ifV is a nonempty 
subset of U and 

(4.1) 0 = ]HI(t, x{t), v) 

= n{t,x{t),v,pi{t),qi{t)) - nit, i{t),u{t),pi{t), qi{t)) 

+ ^ {P 2 {t){<j{t, x{t), v) - a{t, x{t), u{t))),<7{t, x{t), v) - a{t, x{t),u{t))} , 

\/ V GV, a.s., a.e. t G [0,T]. 

where i(-) is the state with respect to u(-), and {pi{-),qi{-)), {P 2 {'), Q 2 {-)) oi'e the 
adjoint processes given respectively by (1.14) (1-15) with (x(-),u(-)) replaced by 

{x{-),u{-)). If the singular control u{-) is also optimal, we call it a singular optimal 
control. 

In the sequel, we shall fix the control subset V C U appeared in Definition 4.1. 
Remark 4.1. In [28], we introduced the concept of singular control in the classical 
sense. Let us recall that, an admissible control u(-) is called a singular control in the 
classical sense if u{-) satisfies 

('Huit,x{t),u{t),pi{t),qi{t)) = 0, a.s., a.e. t G [0,T], 

(4.2) < 'Huuit,x(t),u{t),pi{t),qi{t))au{t,x{t),u(t))'^P 2 it)au{t,x{t),u(t)) = 0, 

[ a.s., a.e. t G [0, T]. 

If (i(-),£t(-)) is an optimal pair, the first-order necessary condition (1.16) says that 
the map 


n ]HI(a;, t, a;(t), n), vGU 

admits its maximum at u(t) for a.e. {uj,t) G LI x [0,T]. A singular control in the 
classical sense is the one that satisfies trivially the first- and second-order necessary 
conditions ( for a.e. {u},t) G LI X [0,T]^ for the maximization problem 

max Tl{t,x{t),v). 

v£U 
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Obviously, when the set V is open and u(t) € V, a.e. {u},t) G x [0,T], any singular 
control in the sense of Pontryagin-type maximum principle satisfies (4-2), that is, u 
is also a singular control in the classical sense, but not vice versa. 

Remark 4.2. Since in this paper we consider the case of diffusion term containing 
the control variable, in (4-1) there exists the second order term 

^ {P 2 {t){cr{t, x{t), v) - a{t, x{t),u{t))), cr(i, x{t),v) - <T{t, x{t),u{t))) . 

When the diffusion term independent of the control variable this term is equal to 0. 
In this case. Definition 4-1 reduces to Definition 2.1. in [24]. 

We need the following simple result. 

Lemma 4.2. Let (Cl) and (C2) hold. Then S(-, x{-), u(-)) G L^{Q; L^([0, T]; R”)) 
and T{-,x{-),u{-)) G Lp(n; ^^([0, T]; L(nR”; R))) for any u{-) G Uad- 

Proof. It is sufficient to prove that 


E 



|§(t, x{t), u{t))\^dt 


< oo 


and 

E f \T{t,x{t),u{t))\'^dt < oo. 
Jo 


By (C1)-(C2), there exists a constant C such that, for (p = b, S, f, 


\‘Px{t)\<C, |(5<p(t)| < C, and \5‘Px{t)\<C, a.e. (w,t) G O x [0,T]. 


Therefore, 


E 


|§(t, x{f), u{f))\^dt 


= E 


^Jo 


'-Jo 


\5bfft)»pi{f) + 5afft)»qi{t) - Sfxit) 


2 2 

+ \^P2{t)*Jh{f) + ]^'^q2{t)*JcT(t) + ^[p2(i)ocr^(t)]*Jcr(t) 

k^l /t-1 

+ ]^[P2{t)o(Jx{t)\»5a{f) + ]^[p2{t) 0^5(7 fft)]*5(j{t) 

2 3 


+ ^[P2(i)o<5crrr(t)]*(5cr(t) + ^ pfff)»^{5(T{f),5a{t))'^dt 


<C + CE 


‘-^0 


Poit) • {Sa{t),Sa{t))'^ 

(biWP + + b2b)P + k2(<)P + \P3{t)ndt 

C: c C'(|bl||l,,4 + ||9l||2,4 + Ib2||l,,4 + Il92||2,4 + IIPsIIL^) 

< OO. 

In a similar way, we can prove that 

cT 


E f \T{t,x{t),u{t))\‘^dt < oo. 
Jo 
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□ 

By Lemma 4.2, it follows that §(•, x{-), v) € L^([0, T]; R")) for any v €V C 

U. By [28, Lemma 3.8], there exists a € L^(0,r;Lp(n x [0,T];R"')) such that 

(4.3) S{t,x{t),v) = E S{t,x{t),v) + f (j)y{s,t)dW{s), a.s., a.e. t G [0,T]. 

Jo 

Denote by <!)(•) the solution to the following stochastic differential equation 

IAA\ / = bx{t)^it)dt + <T^{t)^(t)dW{t), te[0,T], 

\ 4,(0) = /, 


where I is the identity matrix in 

Using the martingale representation formula (4.3), we obtain the following second- 
order necessary condition: 

Theorem 4.3. Let (Cl) and (C2) hold. If u{-) is a singular optimal control in 
the sense of Pontryagin-type maximum principle on the control subset V G U, then, 
for any v G V, it holds that 

E (E,{T,x{T),v),b{T,x{T),v) - 6(r,x(T),u(r))^ 

+d(f (s{t, x{t),v); air, x(t), v) - u(j, x{t), u(t))^ 

+ ^E <^T(T,x(r),r;)(cr(T,x(T),u) - cr(r, x(r), ■u(t))), 

(4.5) a(T, x(t), v) — a(T, x(t), u(t))'^ < 0, a.e.TG[0,T]. 


where 


pT-\-9 pt 


(4.6) ^5+ (^S(r, x{t), v)] air, x{t),v) - a(r, x(r), u(r))) 

(^(j)v ( 5 ; 

$(t)4>(s)“^ x(s), v) — (t(s, a:(s), m(s))) \dsdt, 


:= limsup —E 

e^o+ d 


4>v{-,-) is determined by (4.3). 

The proof of Theorem 4.3 will be given in Subsection 5.1. 

Note that the second-order necessary condition (4.5) is only a pointwise type 
condition with respect to the time variable t [g [0,T]). To obtain the pointwise 
second-order necessary conditions with respect to both the time t and the sample 
point uj (g fl), similar to the first part of our work (see [28]), we need the following 
regularity condition. 

(C3) For any v G V, S{-,x{-),v) G L 2 p(M"), and the map v i-G '\7S(t,x{t),v) is 
continuous on V a.s., a.e. t G [0,r]. 

We have the following result. 

Theorem 4.4. Let (C1)-(C3) hold. If u{-) is a singular optimal control in the 
sense of Pontryagin-type maximum principle on the control subset V G U, then, for 
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a.e. r G [0,T]j it holds that 

(S(r, x(r), v), bij, x{t), v) - b{T, x{t), u(r))) 

+ (V§(r, x{T),v),a{T, x{t),v) - cr(r, x{t),u{t))) 

+ 2 {^{ t , x { t ), v ){( t { t , x { t ), v ) - cr(r,x(T),M(r))), 

(4.7) cr(r, a;(T), ti) — (T(r, a;(r), u(t))) < 0, V v€V, a.s. 


The proof of Theorem 4.4 will be given in Subsection 5.2. 

As an easy consequence of Theorem 4.4, the following pointwise second-order 
condition immediately holds. 

Corollary 4.5. Let (C1)-(C2) hold. If u{-) is a singular optimal control in the 
sense of Pontryagin-type maximum principle on the control subset V G U and 

(4.8) E>{t,x{t),v) = 0, 'i V gV, a.s., a.e.tG[0,T], 
then, for a.e. r £ [0,r], it holds that 

(4.9) {T{T,x{T),v){a{T,x{T),v) - cr(r, ^(t), u(r))), 

air, x{t), v) - (j{t, x{t), u{t ))) < 0, V z; G t/, a.s. 


Remark 4.3. When the diffusion term is independent of the control variable, 
a{t,x{t),v) — a(T, x{t),u(t)) = 0 for any {oj,f) G LI x [0,T]. Therefore, 

(VS(r, x{T),v),a{T, x{t), v) - air, x(t),u{t))) = 0, 

(T(r,i(T),u)(cr(r,x(r),z;) - a{T,x{T),u{T))) ,(t{t,x{t),v) - cr(r, x(r), u(t))) = 0, 
and the condition (4-1) is reduced to 

(S{T,x{T),v),b{T,x{T),v) — b{T,x{T),u{T))) < 0, \/ V G V, O.S., 0 . 6 . TG[0,T], 

where, in this case, 

S{u!,t,x,u) = 'Hx{ix,t,x,u,pi(t),qi{t)) - 'H,,{uj,t,x,u{t),pi{t),qi{t)), 

+ \p2{t){b{uj, t, X, u) - b{u}, t, X, u(t))) 

+ ^(b(uj, t, X, u) - b{u}, t, X, u{t))yp 2 {t), 

(oj, t,x,u) G fl X [0, T] X K" X U. 

The corresponding result coincides with [24, Theorem 2.1]. In addition, since the 
diffusion term is independent of the control variable, yfit) = 0, and hence 

lim [ S{t,x{t),v)yl{t)xEAt)dt = 

E-S-0+ S‘‘ Jq 

In this case, it is unnecessary to introduce the regularity assumption (C3) to prove 
the desired condition (4-1)■ 

Remark 4.4. In Theorem 4-4 j 'xe obtain a pointwise second-order necessary con¬ 
dition for stochastic optimal controls under relatively weak assumptions on the control 
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set U through the perturbation technique of needle variation. However, this approach 
needs considerably high smoothness assumptions on the coefficients b, a, f, and h 
with respect to the state variable x (differentiable with respect x up to the forth order). 
Furthermore, four adjoint equations are introduced to represent this condition. When 
the set U has good structure such that the first- and second-order adjacent sets of U 
on the boundary point of U is nonempty (hut U is still allowed to be nonconvex), some 
perturbation technique from the classical variational analysis can be used to establish 
the second-order necessary conditions for stochastic optimal controls under lower reg¬ 
ularity assumption on the coefficients b, a, f, and h (with respect to the state variable 
x) and only two adjoint equations are introduced to derive the second-order necessary 
conditions. We refer the reader to [8] for a detailed discussion in this respect. 

Two illustrative examples are as follows. 

Example 4.1. Let 

f dx{t) = b{x{t))u{t)dt + u{t)dW{t), t £ [0,1], 

I a;(0)=0, 

[/={ — !, 0, l}, and let 

\u{t)\^dt-^E \x{l)\^. 

Assume that bf) : M —>■ R is bounded and continuously differentiable up to order 
5 with bounded derivatives, &x(0) > 0. Then, the conditions (C1)-(C2) hold. 

For the above optimal control problem, the Hamiltonian is defined by 

nit, X, u,pi,qi) = pib{x)u + qiu - 


(t, x,u,pi,qi) G [0,1] X R X U X R X R. 

Let {x{t),u{t)) = {0,0). The four adjoint equations with respect to {x{-),u{-)) are 
given below: 

f dpi{t) = qi{t)dW(t), t £ [0,1], 

1 Pi(l) = 0; 


f dp 3 {t) = q 3 {t)dW{f), t £ [0,1], 

1 P3(l) = 0; 

It is easy to check that 

{pi{t),qi{t)) = (0,0), {p 2 {t),q 2 {t)) = (1,0), 

(P3(t),93(i)) = (0,0), {pi{t),qi(t)) = {0,0), V (w,t) G H X [0,1]; 


r dp 2 {f) = q 2 {f)dW{t), t £ [0,1], 
\ P2{1) = 1 ; 


f dpi{f) = qi{f)dW{t), t £ [0,1], 
1 P4(l) = 0. 


and. 


Il{t,x{t),v) = 0, S{t,x{t),v) = b{0)v, T{t,x{t),v) = 2bx{0)v, 

Vv £ U, V {u},t) G H X [0,1]. 

Thus, u{t) = 0 is a singular control in the sense of Pontryagin-type maximum principle 
on U. 
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Let = 1, we have 

= 6(0) = E E>{t,x{t),v). 

In this case, VEi{t,x{t),v) = 0, and 

{S(t, x{t), v), bij, x(t),v) - b{T, x{t),u{t))) 

+ (VS(t, x{t), v), cr(r, x{t),v) - aij, x{t), u{t))) 

+ ^{^{T,x{T),v){cr{T,x{T),v) - CT(r,x(r),M(T))), 

cr ( T , x{t), v) - a{T, x{t),u{t))) 

= 6 ( 0 ) 2 + 6 ,( 0 ) 

>0, V(w,6) G 12 X [0,1], 

Therefore, by Theorem 4.4, u(t) = 0 is not an optimal control. 

Example 4.2. Let 

f dx{t) = {u{t) — \)dt + [x{t) — u{t))dW(t), tG[0,l], 

1 a:(0) = 1, 

17 = { — 1, 0, l}, and let 

J(u(.)) = ^E |x(l)-l|^ 

Obviously, (x{-),u{-)) = (1,1) is the optimal pair. The four adjoint equations 
with respect to (x(-),u(-)) are as follows: 

f dpi{t) =-qi{t)dt + qi{t)dW{t), tG[0,l], 

1 Pi(l) = 0; 


dp2{t) = - 

P2{1) = 0; 


P2{t) + 2 q 2 {t) dt + q2{t)dW{t), 


tG [0,1], 


dp 3 {t) = - ipzit) + 3 ^ 3 ( 6 ) dt + q3{t)dW{t), 

Pa)!) = 0; 


and 


[ dp 4 (t) = - Gpiit) + 494 ( 6 ) dt + q 4 {t)dW{t), 
\ P4(l) = -1- 

An easy computation shows that 


6G [0,1], 


1 e [0,1], 


(Pi(6),9i(6)) = (0,0), {P2it),q2{t)) = (0,0), 

(P 3 (l), 93 ( 2 )) = (0,0), (p 4 ( 6 ), 94 ( 6 )) = (-e®“®*,0), V (w, 6 ) G O x [0, Ij. 


Then, we have 


]HI(6, a:(6), r;) = 0, §{t, x{t),v) = 0, T(t,x{t),v) = --e^ ®(v —1)^, 

Vt! G U, V (w, 6) G O X [0,1], 
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and 

(T{t,x{t),v){(j{T,x{T),v) - cr(r,x(T),M(r))), 

cr(r, x(t), v) - cr(T, x(r), M(r))^ 

= 1)4 < 0 , Vt;Gf/, V (w,i) G 11 x [0,1], 

Therefore, 12(1) = 1 is a singular optimal control on U, and the second-order necessary 
condition (4.9) holds. 

5. Proofs of the main results. This section is devoted to proving the main 
results of this paper, i.e.. Theorems 4.3 and 4.4. We need a known result. 

Lemma 5.1. ([28, Lemma 4.1]) Let $(•), ^'(■) € L^(ll;^^(o,T;K")). Then, for 
a.e. T G [0,T), it holds that 

(5.1) ^hm lE^"^'($(r),^‘vl/(s)ds)dt = iE (<i>(r), vl/(r)) , 

(5.2) (^<i>{t),J «'(s)ds^dt = ($(T),^'(r)) . 


5.1. Proof of Theorem 4.3. Since u{t) = u, u G [/ is an admissible con¬ 
trol, in this subsection, we shall still denote by Sip(t) the increment ip(t,x{t),v) — 
(p(t,x{t),u{t)) and by 6(px{t) the increment (pxit,x{t),v) — (px{t,x(t),u{t)) for (p = 
b,a,f. We only need to prove the condition (4.5) holds for a.e. r G [0,T). Let 
T G [0, T), e € (0, T — r) and Eg = [t,t + e) C [0, T). For any fixed v GV, define 


u%t) 


V, t G Eg, 

u{t), te[0,T]\Eg. 


Clearly, u®(-) G Uad- Since u(-) is a singular control on V in the sense of Pontryagin- 
type maximum principle. 


]HI(t,x(t),u) = 0, a.e. (u!,t) G 12 x [0,T]. 
Then, by Proposition 3.4, we have 




B.{t,x{t),v) -k (S{t,x{t),v),'y{t) 


T{t,x{t),v)yl{t),yl{t)) XEAt)dt + o^l) 


S{t,x{t),v),yl{t) + y^{t))xEAt) 


T(t, x{t ), v)yl (t ), yl {t))xE, (t) dt + o{l), 


{e 0+) 

(£ ^ 0+). 


Now, we divide the proof of (4.5) into 4 steps. 
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Step 1: In this step, we prove that 

pT 


(5.3) 


limsup^E [ (s{t,x{t),v),yl{t))xEA't)dt 
£->0+ ^ Jo ' ' 

Ia+(s(r,x(T),t;);(5cr(T)), a.e. r e [0,T). 


By [26, Theorem 1.6.14, p. 47)], ?/i(-) has the following explicit representation: 

y^(t) = -$(t) f <^>{s)-^a^{s)Sa{s)xEAs)ds 
Jo 

+$(t) f $(s)“MtT(s)x£;Js)dVF(s). 

Jo 


(5.4) 

Consequently, 


72^ Jo {^A^^iO,u),yl{t)'jxEAt)dt 

(s{t,x{t),v),^{t) f ^{s)~^ax{s)Sa{s)ds)dt 


rr+s 


= --E 


(5.5) J a:(t), r^), 4>(t) J $(s) ^Sa{s)dW{s)'jdt. 


By Lemma 5.1, it follows that 

rT+e 


lim 

e^0+ . 


—E J (s{t,x{t),v),^{t) J $(s) ^ax{s)Sa{s)ds'jdt 

(5.6) = -Ie ^§(T,x(T),'c),(Ta:('r)5(7(r)^, a.e. Te[0,r). 


Next, by (4.4), we deduce that 

rr+e 


limsup^E J (s{t,x{t),v),^{t) J ^{s)~^Sa{s)dW{s)'jdt 

= limsup^E J (s{t,x{t),v),^{T) j ^{s)~^Sa{s)dW{s)'jdt 

x{t),v), J bj:{s)^{s)ds ■ 


+ lim sup ^E 
£->■ 0 + ^ 


+ lim sup — E 
£->■ 0 + £ 


<i)(s) ^6a{s)dW{s)'jdt 


f-T+e 


x{t),v), / ax{s)^{s)dW{s) 


<I)(s) ^Sa{s)dW{s)'jdt. 


(5.7) 


By (4.3) and (4.6), it holds that 

lim sup — E J (s{t,x{t),v),^{T) J <i>(s) ^Sa{s)dW{s)'jdt 
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= limsup^E J (e S{t,x{t),v) + J 4>v{s,t)dW{s), 

f ^(^T)^{s)~^Sa{s)dW{s)'jdt 


= limsup 
£->• 0 + ^ 


/'T-\-e nt 


J i), $(r)$(s) ^6a{s)'jdsdt 


(5.8) 


i9+(§(T,x(T),w);5cr(T)) a.e. r S [0,r]. 


On the other hand. 


lim 

E— >-0 + 




pr+e 


x{t),v), J bj:{s)^{s)ds ■ 

f ^{s)~^S<T{s)dW{s)'jdt 


rr+e _ 


< lim 
£->■0+ 


4\ i 


(^E |S(t, ^ (^E J bx{s)^{s)ds ^ 

(e f <S>{s)-^Sa{s)dW{s) 


dt 


< lim^ — / (t — t)^ ^E |S(t, a;(<), ri)! j dt 
(5.9) =0 a.e. r S [ti,T]. 


Also, 


lim 

£—>■ 0 + 


< lim 
£->■ 0 + 




pr+e 


,x{t),v), j (Ta:(s)<i)(s)dhr(s) 
1 , 


$(s) ^5(T(s)(iM^(s)^dt —-E (^{T,x{T),v),ax{T)5a{T)^ 


pr-\-e 


rE 


,x{t),v) - S{t,x{t),v), 


■ lim 

£^0+ 


-^E / 


1 

< lim ^ / 


£->■ 0 + 


E 


+ lim 

£—>•0 + 

.. c 

< lim — 

£->■ 0 + e , 


J ax{s)^{s)dW{s) J <i>(s) ^Sa{s)dW{s)'jdt 
(e>{t,x{t),v), J ax{s)^{s)dW{s) ■ 

Sa{s)dW{s)'jdt - ^E (s{t, x{t) , v), ax{T)Sa(T)'j 

r+e 1 

E |§(t,x(t),r;) —S(T,a;(r),z;)|^ 

^ J |o’a;(s)<i)(s)|^ds^ ^ (y 

E (s(t, x{t),v)^ crxis)Scr{s) — ax{T)Sa{T)'^dsdt 


pT-\-e pt 


r 


E \S{t,x{t),v)-S{ t,x{t),v)\^ 


' dt 
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+ lim 
£—>0 + 


2 rt 

72 / 


E (s(t, x{t),v), ax{s)Sa{s) — ax{T)Sa{T)'^dsdt 

(5.10) =0, a.e. TG[0,r). 

Then, by (5.7)-(5.10), it follows that, for a.e. r G [0,r), 

lim sup — E J (s{t,x{t),v),^(t) J <i>(s) ^Sa{s)dW{s)'jdt 

(5.11) = i5+(^S(T,i(T),?;);(5cr(r)) + ^E (s{T,x{T),v),ax{T)6a{T)y 


Combining (5.6) with (5.11), we obtain (5.3). 

Step 2: In this step, we prove that, for a.e. t G [0,T), 

-j r'~^ 1 

(5.12) ^hni^ —E J (s(t,x(t),v),y^(t)'jxE,it)dt = -E ^§(t, i(T),-u), ^^(t)^ 
Similar to (5.4), the explicit representation of y^i') is given as follows: 

pt 


yUt) = ^it) «'(s) ^ ^fea:x(s)(yf(s),yf(s))+(S6 (s)x£;^(s) 

-^<^x{s)(Jxxis){yl{s),yl{s)) - crx{s)6ax{s)yl{s)xEAs) 


ds 


(5.13) +4>(t) / 4>(s) ^ ^(Txxis){yt{s),yl{s))+Sax{s)yl{s)xEAs) dW{s). 


Then, 


x{t),v),<^{t) f <^{s)-^\bxx{s){yl{s),yl{s)) 


rT-\-e 


= lim —E 
E^o+ 2e^ 


ds)dt 


+ lim ^E 
£->0+ 


-ax{s)axx{s){yl{s),yl{s)) 

J <^{s)~^5b{s)xEAs)ds^d,t 

Ihn^^E J (s{t,x{t),v),^{t) J ^is)~^ax{s)Sax{s)yl{s)xEAs)ds'jdt 

(Sit,x{t),v),^{t) $(s)”^ ^crxx(s)(2/i(s),yi(s)) 

+^cr:j,(s)yi(s)xi5,^(s) dWis^dt. 


rr-\-e 


rT+£ 


+ lim 

£^0+ ^ 


(5.14) 


By (5.4), yi{t) = 0 for any t G [0, r). Therefore, by Lemmas 3.2 and 4.2, 


lim 

e^0+ 


^eJ (s{t,x{t),v),<S>{t) ^s) ^ bxxis){yl{s),yl{s)) 


-crx{s)axx{s){yl{s),y^^{s)) 


ds )dt 
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= lim 

e^0+ 


< 


j (s{t,x{t),v),<^{t) J $(s) 1 6xx(s)(yi(s),yi(s)) 

-Crx(s)CTa;x(s)(yi(s),2/l(s)) 

E\S{t,x{t),v)\^dty E J $(s)-i- 


ds )dt 


1 ^ 1 ^ 

foxa:(s)(yi(s),?/i(s)) - (Jxis)axx{s){yl{s),yl{s))ys dtj 

I [ (t-T)2E [ sup |$(i)$(s)"^| • sup |?/i(s)f diV 

'-se[o.T] se(o.T] J J 

('T-\-S 1 . 1 . 

i’o+Tri j ■ {e [ sui^ |yi(o|^ 


< lim^ 

e^0+ 


< 


e—>0+ £2 

= 0, a.e. T e [0, T). 

(5.15) 

Next, from Lemma 5.1 we conclude that 


2^ /-T + E 

lim — E 

e->0+ 


t,x{t),v),^{t) J d>(s) ^6b{s)xE^is)ds'jdt 
(5.16) = -E ^§(r, x(t), u), (56(r)^ a.e. r S [0,T). 


Also, by Lemmas 3.2 and 4.2, we deduce that 


lim 

e^0+ 

= lim 

E^0+ 


1 


E 


>. 


pr+e 


pT+e 


(S{t,x(t),v),<^{t) J $(s) ^axis)Saxis)yl{s)xEAs)ds'jdt 

(S{t,x{t),v),^{t) f ^{s)~^axis)Saxis)yl{s)dsjdt 


< lim — 


E->0+ L 


9 ■ 

J E |S(t,a;(t),u)| dt 


rr+e 


< 


E |$(t) J $(s) ^ax{s)Sax{s)yl{s)ds\^dt 
lim^ — I J E |§(t,a;(t),u)|^dt| • 


T+e 


(t — t)^E sup |<I)(t)$(s) ^1 • sup |yi(s)| dt\' 

Lse[o.T] se[o.T] J I 


< 


C f 9 'i - r r 1 'I 

lim — I / E |S(t,x(t),u)| dd" • |e sup |yi(s)|'‘ [ 
-*■0+ £2 Jx ' J l J J 


£—>•0+ E2 

= 0, a.e. T € [0,T). 

(5.17) 

In a similar way, we obtain that 


lim 

e->0+ 


d. 


pr+£ 


y(t,x(t),v),^(t) f $(s) ^ ^cr^x(s)(2/i(s),yi(s)) 
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= lim 

e—>0+ 


< lim 
£->• 0 + 


rE 


rE 


rr+e 


rr+e 


+5(T^{s)yl{a)xEAs) dW{s)'jdt 

(E>{t,x{t),v),^t) J «>(s)"^ ^cr:,^(s)(2/f(s),2/i(s)) 

+(5crx(s)?/i(s) dW{s)'^dt 


S(t,x(t),v) - $(r)^S(T,a::(T),-i;), 
■1 


' lim 

e^0+ 


i r« 


< 


$(s) ^ ■^cra;x{s){yl{s),yl{s)) + Saa:is)yl{s) dW{s)'^dt 
(s{t,x{t),v),<^?{t) J $(s)-i ^<^xx{s){yl{s),yl{s)) 

+<^cr 2 :(s)?/^(s)j dW{s)'jdt 

lim —■{ / E ^{t)^S(t,x(t),v) — ^(t)^S(t,x(t),v) dt\^ ■ 

^•0+ ^ Jx J 

}' 


r+£ pt 




dsdt 


< 


C r 2 N i 

lim —\ E ^(t)'^E>(t,x(t),v) — ^(t)^S(t,x{t),v) dt}' 

e->o+ e I Jx J 


{[e( sup \ylit)f) 


E 


( sup \yl 

^ tG[0,T] 


= 0, a.e. T € [0, T). 

(5.18) 

Here, we have used the fact that 


\-i 


rl 


E(^S(r,a;(T),u),$(r) J $(s) " (-cra:xlsj(yi(,sj, ylfs 
for any t G [r, T], 

Combining (5.15)-(5.18) with (5.14), we obtain (5.12). 
Step 3: In this step, we prove that 


dWis)"^ = 0 


1 1 

^E J (T{t,x{t),v)y'{{t),yl{t)'jxE,it)dt = -E <^T(t, x(t), ?;) 5 cr(r), ^cr(r)^ 


e->0+ 

(5.19) 


Similar to the pervious discusses, we have 

rT 


^E^ (T{t,x{t),v)yl{t),yl{t)'jxEAt)dt 

(T{t,x{t),v)(^ - ^{t) j ax{s)5(j{s)ds 


1 

= lim ^E / 


e^0+ £' 


+<i)(t) J $(s) ^5cr(s)(iil4(s)^ , 

—$(t) J ^{s)~^ax{s)Sa{s)ds + J ^{s)~^6a{s)dW{s)'^dt 
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= lim [ (T(t,x(t),v)^(t) [ <I)(s) ^6a(s)dW(s), 

e^o+ \ 

$(i) J ^{s)~^6a{s)dW{s)'^dt 

= (T{T,x{T),v)Sa{T),Sa{T)y a.e. r S [0,r). 

This proves (5.19). 

Step 4: From Step 1-Step 3, we have proved that, for any v gV, 


0 > lim sup 
£->0 + 

1 


J{u{-)) - J(u®(-)) 


= 2^ {Ht, x{t), v), Sb{T)'^ + -d+ (s{t, x{t), v); ^cr(r)) 

+ -E ^T(t, x(T),u)(5CT(T),(5cr(r)^, a.e. t G [0,T). 

Therefore, for any n G 17, it follows that 

E {^{T,x{T),v),5h{T)^ + {^{t,x{t),v)]5(7{t)^ 

+ -E ^T(t, a;(r), n)(5cr(r), (5cr(T)^ < 0 a.e. r G [0,T). 

This completes the proof of Theorem 4.3. 

5.2. Proof of Theorem 4.4. We borrow some idea from the proof of [28, The¬ 
orem 3.9]. Denote by the totality of rational number in [0,T), by a 

dense subset of V, and by the countable subfamily of J)., i G N such that for 

any A G J^t-, there exists {Aij^}^^^ C {Aij}^^ such that lim„_>oo = 0, 

where AAAij^ = (A \ Aij^) U {Aij^ \ A). 

For any fixed ti, and Aij G Fa , let r G [t^, T), e G (0, T—t), = [t, T-fe), and 


write = 

Had- Put = 

tion (4.1), we have 


_ j M(w,t), (a;,<) G (D X [0,r]) \ (Ay X [ti,T]), 


{u},t) & Aij X [ti,T]. 


Clearly, uU-) G 


M* (t), teE,, 

u{t), tG[0,r]\£'£. 


By Proposition 3.4 and using the condi- 


0 > 


J(m(-)) - J{uH-)) 


= 4e 


pT ^ 


M{t,x{t),v^) + {E>{t,x{t),v'^),yl{t)+ y^{t)) 

+ l {^{t,x{t),v’^)yl{t),yl{t))]xA,iXEAt)dt + o{l) (e ^ 0+) 




T ^ 




(5.20) 


+ 2 (T(Ca;(t),u'=)y]^(t),yf(t))Jx^yXBe(i)d< + o(l) (e ^ 0+). 


where yl{-), y^i') are the solutions to the variational equations (3.4) and (3.5) with 
respect to u^{-), respectively. 
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We first prove that there exists a sequence —>■ 0+ as £ oo, and, 

= (vS{t, x{t), v’'), a{T, x{t), v^) - a{T, x{t), u{T))'^XAij , a.e. t e [U, 
By (5.4), y\(-) enjoys the following explicit representation: 

yi(0 = -^(t) [ ^{s)~^(^x{s){a{s,x{s),v’^) - a{s,x{s),u{s)))xA.jXEAs)ds 
Jo 

(5.22) +$(t) f <i>{s)-^{a{s,x{s),v'‘) - a{s,x{s),u{s)))xA,^XEAs)dW{s). 

Jo 


Then, 


j J $(s)"V;:,(s) 

•(cr(s,x(s),-i;'') - a{s,x{s),u{s)))xAijds)xAijdt 


+ ^E 


nr+e 


(5.23) 


(s{t,x{t),v'^),^{t) J $(s) ^ 

•(ct(s, x(s), w'^) - cr(s, x(s), u{s)))xAi,dW{sfjXAi^dt. 


By Lemma 5.1, we obtain that for a.e. r S [ti,T\ 


lim 


fT+e 


- ^E 


e-i- 0 + L £ 


=-E 

2 


(E:{t,x{t),v),<^{t) J $(s)“V,r(s) 

•(cr(s,x(s),u'') - cr{s,x{s),u{s)))xAijds^XAijdt 
, x{t), v^), a^{T) {a{T, x{t),v^) - cr(r, x{t), u{t))) )xa. 


(5.24) 


On the other hand, by (4.4), we deduce that 


= lim —E 
e->0+ e‘‘ 


rT+e 


Irn^^IE/ (S{t,x{t),v'^),<^{t) J 4>(s) ^ 

■{a{s,x{s),v'") - a{s,x{s),u{s)))xAijdW{s)'jxAijdt 
(s{t,x{t),v^),<i>{T) j $(s)“^ 

■{a{s,x{s),v'") - a{s,x{s),u{s)))xAi:jdW{s)'jxAijdt 

(s{t,x{t),v’^), J 6x(s)4'(s)ds j 4’(s)“^ 

■{a{s,x{s),v'") - a{s,x{s),u{s)))xAi^dW{s)'jxAijdt 


+ lim —E 
£->■ 0 + , 
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lim^ djE J (s{t,x{t),v''), J ax{s)^{s)dW{s) J $(s) ^ 

• (ct(s, xis),v'") - a(s, x(s),u(s)))xA,j dW (s)^XAy dt. 


(5.25) 


Similar to the proof of (5.9)-(5.10), we obtain that, for a.e. r G [ti,T], 

(5.26) lim^ J (s{t,x{t),v'"), J bx{s)^{s)ds J ‘h(s)“^ 

■{a{s,x{s),v^) - a{s, x{s), u{s)))xAijdW{s)^XAijdt 


= 0 , 


and 


1 r+^ 

lim —E / 

e_^o+ 


= ^E 
2 


J (Ta:(s)d>(s)dVF(s) j d>(s) ^ 

•(cr(s,i(s),v'') - a{s,xis),u{s)))xAijdWis)'jxAijdt 
(s{t, x{T),v''),a^{T){a{T, x{t),v'') - (7(r, x{t), u(t))) 


(5.27) 

Then, by (5.23)-(5.27), in order to prove (5.21), it remains to show that there exists 
a sequence —>■ 0+ as cxd such that 


J {Ht,x{t),v’^),<^{T) J $(s) ^ 

■{ais,x{s),v^) - a{s,x{s),uis)))xAi^dWis)^XAi^dt 

= ^E (|vS(r,i(T),n'=),cr(r,5(T),'y'') - (T(T,i(r),u(r))^XA„ , a.e. r G [t*,T]. 
(5.28) 

By the regularity assumption (C3) and the Clark-Ocone representation formula, we 
have that 


Ie 


, a;(t), ?;'"), $(r) J $(s) ^ 

■{a{s,x{s),v’") - a{s,x{s),u{s)))xAi^dW{s)'^XAijdt 
(e S(t, x{t), j' $(s)-i 

■{a{s, x{s), v^) - cr(s, x(s), u{s)))xAijdW{s)^XAijdt 




pr-\-£ ^pt pt 

V,§{t,xit),v'^) Ts dB^(s),$(T) / $(s)-i 


E 


0 


■{a{s, x(s), v^) - cr(s, x{s),u{s)))xAijdW (s)^XAy dt 
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$(r)$(s)“^ (cr(s, x{s), v^) - cr(s, x{s), m(s)))xa.,- 'jxAijdsdt 
= (VsHt,x{t),v^) -VS{s,x{s),v>^), 

$(r)$(s)"^ (ct(s, xis),v'") - a{s, x(s), u(s)))xAy 'jxA^.dsdt 
+ ^E J' (vSis,xis),v^), 

(5.29) $(r)$(s)“^(cr(s,x(s),?;'^) - a{s,x{s),u{s)))xAi^)xAi^dsdt. 


By the assumptions (C1)-(C3) and [28, Lemma 2.1], there exists a sequence 
e:^ —i> 0+ as £ —>■ cx) such that 


lim -rj 

f-s-oo ei 


i-T+ee rt 


E 


J (Vs^t, x{t),v'^) - V§(s, x{s), v^), 


$(r)$(s) ^(cr(s,a;(s),?;'^') - (T{s,x{s),u{s)))xAij)xAijdsdt 


< lim 


C 


E 


i^oc£(l \s^[r,T] 


( sup |$(t)$(s) 

V ca\n- T] / 


nT-\-ef, ft 


E 


r>,§(t, x(t), v'^) - VS(s, x{s), v'^) 


dsdt 


= 0, a.e. T G [ti,T]. 

(5.30) 

On the other hand, by Lemma 5.1, 

lim^ ^E J J (vE>{s,x{s),v^), 

$(t)$(s)"1 ((t(s, i(s), v'") - a{s, i(s), u(s)))xAy '^XAi^dsdt 

= ^E (|vS(r,i(T),u'=),cr(r,5(T),'(;'') - (T(T,i(r),u(r))^XA„ , a.e. t G 

(5.31) 

Combining (5.29), (5.30) with (5.31), we obtain (5.28). By (5.23)-(5.28), we obtain 
(5.21). 

Next, similar to Steps 2 and 3 in the proof of Theorem 4.3, we obtain that 


(5.32)^mn^^E J (E>{t,x{t),v'^),y^{t)'^XEAt)dt 

(s{t, x{t), w'^), 5(t, x{t), v^) - b{T, x{t), ■u(T))^XAi, 


-E 


and 


1 

(5.33)^hm^^E J (T{t,x(t),v)yl(t),yl{t)'jxEAt)dt 


a.e. T G [ti, T]. 
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Finally, combining (5.20), (5.21), (5.32) and (5.33), we end up with 


- cr(T,a;(T),M(r))), 

a{T,x{T),v'‘) - a{T,x{T),u{T)))xAi^ , a.e. T €[ti,T]. 


E 


(S(t, x{t),v''), b{T, x{t),v‘") - b{T, x{t),u{t))) 


+E 


--E 

2 


(5.34) 


(V§(t, x(t), v^), a{T, xiT),v'") - a{T, x(t), u(t))) xa,, 
(T(r,x(r),i;'=)(cr(T,x(T),?;'=) - a{T, x{t),u{t))) , 

cr(r, x{t), v^) - a{T, x{T),u{T)))xAi, 


< 0 . 


By the arbitrariness of i, j, k, the construction of the continuities of the 

hlter F and the map v i-A VS(t, x{t),v), and the density of we conclude that 

the desired necessary condition (4.7) holds. This completes the proof of Theorem 4.4. 

Appendix A. Proof of Lemma 3.2. To simplify the notation, we only prove 
the 1-dimensional case (The high dimensional case can be proved in the same way). 

The proof is long and requires heavy computations (The main idea comes from 
the proof of [26, Theorem 4.4, p. 128]). We will divide it into 4 steps 
Step 1: Estimation of II MWL.p and 
By the conditions (C1)-(C2) and the estimate (3.2), we have 


sup \yl{t)\^ 

'-tG[0,T] 


(A.l) E 

In a similar way, we have 


< CE 


\S<j{t)xEAt)\ dt 




< Ce^. 


E 


sup 

te[o.T] 


(A.2) 


< CE 


, 1 , 


■-./o 


-fCE 

< cjE 

-l-E 


bxxit)yl{tf + Sb{t)xEe{t)\dt 


\^(^xxit)yt{t)^ + Sa^{t)yl{t)xEAt)\ dt 


sup \ym\"^ +e^ 

'-te[o,T] 

' sup +E 

'-te[o.T] 


sup |?/]^(t)|^]£21 < C'e'^ 
= rn T'l J J 


'-tG[0,T] 


E 


sup 1^3 (t) I 

'-te[o.T] 

T 


< CE 


]^Kxit){2yl{t)yAt) + yl{tf) + ^b^xx{t)yl{tf 


‘-^0 

+dbAt)yl{t)xE, {t)\dt 


CE 


1 


‘-^0 


+ vlAf) 


+ \<yxxxit)yl{tf + SaAAvUAXE, (t) + l:S(Jxxit)yUtAxEAt)\^dt 
D 2 ' . 
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< C'<^E 


sup m)\^\ym^ 


'-te[o.T] 


+ E 


sup 

'-te[o.T] 


(A.3) 


+E 

■ sup \yl{t)\^P 

+ E 

sup \yl{t)f 


'-tGp.T] 


Ce[o,T] J 


+E 


sup \ymf 

LtGlO.T] 


£2 +E 


sup \yl{t)\^^ 
'-te[o,T] 


£2 ^ < Ce- 


and 


E 


sup \ymf 
'-te[o.T] 


< CE 


1 


b^^{t){2yl{t)yi{t) + 2y|(i)2/^(i) + y^tf) 


-g&xxx(i)(32/?W^2/2W +32/fW2/2W^ 

~b^xxx{t)yl{t)'^ + Sb^{t)y^{t)xEAt) + ^Sb^x:{t)yUt)^XEAt)\dt 


+CE 


'-Jo 


\^cT^x{t){ 2 yl{t)yAt) + 2 yAt)yl{t) + yl{tf) 


+-^(Txxx{t){iyl{tfyAt) + ^yiA)y2Af + y2Af) 


24 


(Txxxx {t)yl {tf + 5ax {t)yl {t)xE, (t) 


2 

< c|e 


^Saxx{t){2yl{t)yAt) + yAtf)xEA0 + ^Saxxx{t)yUtAxEAt)\^dt 


sup \yAt)f\ylit)A 

'-tG[0,T] 


+ E 


6 

sup \ymf\ymf 

'-tG[0,T] 


+E 

+E 

+E 

+E 

+E 


sup lyAOf^ 

'-tG[0,T] 


+ E 


sup \ym\^AyAt)\^ 

'-tG[0.T] 


sup \yAt)f\yAt)\^^ 

'-tG[0,T] 


+ E 


sup 
'-te[o,T] 


sup \yAt)\^^ 

tG[0.T] 


+ E 


sup \ym\^ 

tG[0,T] 


sup \yAt)\^^ £''+E 

'-tG[0,T] J 


sup \yUt)f 

'-tG[0,T] 


£2 


sup \yAt)f\ymf 

tG[0.T] 


£2 +E 


sup \ym\^^ 

tG[0.T] 


£ 

£2 


(A.4) +E f sup lyAO^e^ 

'-tG[0,T] J 

Step 2: Estimation of ||ri||^_^, ||r 2 ||l_^ and ||r 3 ||^_^ 
By (3.3) and the condition (C1)-(C2), we have 


E 

(A.5) 


sup \Sx(t)A 
'-te[o,T] 


< CE 


'-./o 


\db{t)xEAt)\dt 


+ CE 


<Ce^ + Ce^ <Ce^. 


'-Jo 


\d(j{t)xE, it)\^dt 




















































Pointwise second-order necessary conditions 


33 


Define 

[ hit) := J^b^{t,ex{t) + {i-e)x^t),u^{t))de, 

[ := fg aa:(t,dx(t) + (1 - 9)x^{t),u'^{t))d9. 

Then, 6x{-)=x‘^ {■)—x{-) is the solution to the following stochastic differential equation: 


dSx{t) = b%{t)5x{t) + Sb{t)xEsit) 


dt 


(A.7) 


d%{t)5x{t) + 5<7{t)xE,it) dW{t), t e [0,T], 


fa(0) = 0. 


Also, ri(-) = Sx(-) — yf(-) is the solution to the following stochastic differential equa¬ 
tion: 


dri(t) = b^(t)ri(t) +Sb(t)xEAi) + (k(t) “ bx(t))y!(t) 


dt 


dUt)ri{t) + - a^{t))yl{t) dW{t), t£[0,T]. 


(A.8) 
Since 


ri(0) =0. 


E 


= E 


< E 


IKit) - b^{t)\dt 


^JO 


'-Jo 

T 


^Jo 
< CE 


bj:{t,9x{t) + (1 - 9)x^{t),u^{t)) - bx{t)d9 

) 

J (^L\x^{t) -x{t) \ + \Sbj:{t)xEe{t)\^dt 


dt 


and 


E 


= E 


sup \6x{t)\^ +Ce^<Ce^, 

'-tG[0,T] 1 


-'yxiOl dt 




< CE 

< CE 


‘-J 0 


ax{t, 9x{t) -I- (1 - 9)x’'{t), u®(t)) - cFx{t)d9 


[L\x‘'{t) -x{t)\‘^ + \5a^{t)xEAt)\'^)dt 


dt 


sup |(5a;(t)|^ 
'-te[o.T] 


/3 fi 

+ Ce^ < Ce^, 


we have 
E 


sup |ri(t)|^ 

'-tG[0.T] 


< CE 


'-^0 


-tCE 


'-Jo 


\db{t)xEAt) + (Kit) - bx{t))yAt)\dt 

\idUt) - <^x{t))yl{t)\^dt 
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(A.9) 


<C\ 


|e^+E[( sup 

LVtgfQy] 


+e[( sup \ymf)( r\m 


^l{t) -cFx{t)\dty 

-h,{t)\^dt)^]]<CeP. 


This gives the estimation for ri(-). 

Next, we prove the estimation for r 2 (-). For (p = b,a, by Taylor’s formula, we 
have 


= V’it, x^{t), u{t)) - p{t, x{t), u{t)) + p{t, x{t), u^t)) 

-p{t,x{t),u{t))+<p{t,x%t),u^t)) - <p{t,x{t),u^{t)) 

-p{t, x^t), u{t)) + p{t, x{t),u{t)) 

= px{t)5x{t) + 

2 ^XX {t)Sx{t)^ + S<p{t)xEAi) 

1 

+ 0 / S^‘Pxxx{t,Ox{t) + {1 - 9)x^{t),u{t))6x{t)^d9 
^ Jo 

+ J (v^xitj^x^t) + (1 - 9)x'^{t),u‘^{t)) 

(A.10) —px{t, 9x(t) + (1 — 9)x‘^{t), u{t))^Sx(t)d9 

— P^xijJ)dx{iJj -\- ~p XX (j') d X ~Pxxx(j')dx(^t^ 

+Sp{t)xEAt) + dpx{t)5x{t)xE, {t) 

1 

+ F / ^^P^xxxx{t,9x{t) + {I - 9)x^{t),u{t))5x{t)'^d9 
6 Jo 

+ J 9(^pxxit,9x{t) + {1 - 9)x^(t),u%t)) 

(ATI) —pxx{t,9x{t) + (1 — 9)x'^ (t),u(t))^Sx(t)^d9 

= Px{t)Sx{t) + ^Pxx{t)Sx{t)^ + ^iPxxx{t)dx{t)^ 

+ S(p{t)xEA't) + d‘Px{t)6x{t)xE, (t) + ^Spxx{t)Sx{tfxEAt) 

1 

+ F / S^<fxxxx{t,9x{t) + {1 - 9)x^{t),u{t))Sx{t)'^d9 

6 Jo 

+ ^ J 9^(^ipxxx{t,9x(t) + {I - 9)x%t),u‘^{t)) 

(A.12) -pxxx{t,9x{t) + (1 - 9)x'^{t),u(t))^dx(t)^d9 

= px{t)6x{t) + 2 ^XX {t)5x{tY + g ^XXX {t)5x{tf + 5p{t)xEM 

+dpx{t)5x{t)xE,{t) + ]^5pxx{t)5x{tYxE,{i) + ^5pxxx{t)dx{tYxEM) 
+ - J 9^pxxxx{t, 9x{t) + (1 - 9)x^{t), u{t))dx{t)'^d9 
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+ ■ 




(A.13) 


^xxxx{t, Ox{t) + (1 - 0)x%t), u’^{t)) 

-^xxxx{t,9x{t) + (1 - 9)x^{t),u{t)))5x{tYd9. 


By (A.10) and (A.11), we find that 5x{-) is the solution to the following differential 
equation: 


dSx{t) = bj;{t)Sx{t) + \b:^x{t)dx{tY + Sb{t)xEA*) 

+1 fo ^^^xxx(t, 9x(t) + (1 - 9)x^{t),u{t))8x{tfd9 
+ fo (9x(t,9x(t) + (1 - 0)x^(t),u®(t)) 

—bx{t, 9x{t) + (1 — 9)x'^{t), u(t)))Sx(t)d9 


(A.14) < 


dt 


ax(t)5x[t) + ^(Jxx{t)8x{tY 


+ ^(^x{t)5x{t)xEeit) 

+ \ fg 9^axxx(t, 9x{t) + (1 - 9)x’^{t),u{t))5x{t)^d9 
+ fo 9{cFxx(t,9x(t) + (1 - 9)x%t),u‘^(t)) 

—cTxxit, 9x(t) + (1 — 9)x^{t),u{t)))5x{t)'^d9 dW{t), 
t€ [0,T], 

. (5a;(0) = 0. 

Similarly, by (A.11)-(A.13), (5a:(-) is the solution to the stochastic differential 
equation 

d5x(t) = bx{t)5x{t) + \bxx{t)5x{tY + lhxxx(t)5x{tY 

+5b{t)xE,{t) + 5bx{t)5x{t)xE,{t) 

+ i fo ^^bxxxx{t, 9x{t) + (1 - 9)x^{t),u{t))Sx{t)'^d9 
+ fo ^(f>xx(t, 9x(t) + (1 - 9)x’^{t), u’^{t)) 


(A.15) < 


—bxx{t, 9x{t) + (1 — 9)x'^{t), u(t)))Sx(t)^d9 dt 

+ ax{t)5x{t) + ^axx{t)Sx{t)‘^ + \(Jxxxit)5x{tf 

+6a{t)xEAt) + 5(^x{t)5x{t)xE, it) + ^S(Txxit)5xit)'^XEAt) 

+ 5 fo ^^^xxxxit, 9xit) + (1 - 9)x%t),uit))Sxit)‘^d9 
+ 1 fo ^^(<^xxx(i,9x(t) + (1 - 9)x^{t),u^it)) 

-cfxxxit,9xit) + (1 - 9)x'^{t),u{t)))6x{t)^d9 dWit), 
t€[0,T], 


. 5x(0) = 0, 
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and the stochastic differential equation 

d6x{t) = bx(t)5x{t) + \bxx{t)5x{tY + ^bxxxit)Sx(t)^ 

+Sb(t)xEjt) + Sbx(t)Sx(t)xE, (t) + \5bxx{t)5x{tYxEAi) 

+5 fo ^^bxxxx{t, Ox{t) + (1 - 9)x^{t), u{t))Sx{t)*de 
+ 5 fo 9^(bxxx(t,9x(t) + (1 - 0)x^(t),u^(t)) 

—bxxx(i, 0x{t) + (1 — 9)x^{t),u{t))'^5x{t)^d9 dt 

+ ax{t)5x{t) + \(Jxx{t)5x{t)'^ + \(7xxx{t)5x{tY 

j^§(j{t)xEe{t) + Sax{t)Sx{t)xEAt) 

+ ^6(Jxxit)Sx{t)^XEAt) + \5(^xxx{t)^x{tYxEAi) 

+ i fo 9x(t) + (1 - 9)x‘^(t), u(t))Sx(t)‘^d9 

+ 5 fo ^^(^^xxx(t,9x(t) + (1 - 9)x^(t),u^(t)) 

-crxxxx{t,9x{t) + (1 - 9)x'^{t),u{t)))Sx{tyd9 dW{t), 

<e [0,T], 

fe(0) = 0. 

Combining the variational equations (3.4) and (3.5) with the equation (A. 14), we 
see that r 2 (-) is the solution to the stochastic differential equation: 


dr2{t) = bx{t)r2{t) + ^bxx{t){Sx{t)'^ - yi{t)^) 

+ 1 fo ^^^ooxx{t, 9x{t) + (1 - 9)x'^{t), u{t))Sx{t)^d9 
+ fo (9x(t:9x(t) + (1 - 9)x^(t),u^(t)) 

—bx(t, 9x(t) + (1 — 9)x^(t),u(t)))Sx(t)d9 dt 
(A.17)^ + <^x{t)r2{t) +^axx{t){Sx{t)'^+5ax{t)ri{t)xEe{t) 

+ 1 fo ^^^x:xx(t, 9x(t) + (1 - 9)x^(t), u{t))Sx{t)^d9 
+ fg 9(axx(t,9x(t) + (1 - 9)x‘^(t),u'^{t)) 

—(Jxx{t, 9x(t) + (1 — 9)x‘^(t),u{t)))Sx(t)^d9 dW(t), 
t€[0,T], 

r 2 ( 0 ) = 0. 

By the conditions (C1)-(C2), we have 


E 


'-./o 


9^bxxx{t, 9x{t) + (1 — 9)x'^{t),u{t))6x{t)^d9 


dt 


(A.18) ^CE / \Sx{tf\dt 


<CE 


sup |fa(t)|3^ 
te[o,T] 


3/3 

< Ce^. 
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E 




(bx{t, 9x{t) + (1 - 0)x'^{t), u^it)) 
—bx{t,9x{t) + (1 — 9)x’^ (t),u{t))\Sx(t)d9 


dt 


(A.19) <CE / \Sx{t)xEAt)\dt 
L JO 


< C E 


sup \5x[t)\^ 

'-tG[0,T] 


e^<Ce^. 


E 


^ 9x{t) + (1 — 9)x‘^{t), u{t))Sx{t)^d9 


'-Jo 


dt 


(A.20) < CE 
and 

E 


|(5a;(t)^| dt 


'-Jo 


< CE 


sup \Sx{t)\^^ 

'-tG[0,T] 


3/3 

< Ce-, 


'-Jo 


9{(Jxx{t, 9x{t) + (1 - 9)x%t), u‘'{t)) 

—(Jxxit, 9x{t) + (1 — 9)x'^{t), u{t)))Sx{t)‘^d9 


dt 


(A.21) < CE 


\SxitfxE, it)\‘^dt 


< CE 


sup \5x{t)\^^ 

tG[0.T] 


3 3/3 

£2 < C£ 2 . 


On the other hand, combining (A.l) and (A.5) with (A.9), we have 


E 


sup \5x{tf-yl{tff 

06(0.T] 


= E 


sup {\ri{t)f\Sx{t)+yl{t)f) 
‘-te[o,T] 


i 1 

(A.22) < (Ef sup |ri(t)|2dy sup \5x{t) + yf{t)\^d']y ^ Ce^. 
^ Ug[o,t] Jj V L^crn'T’i Jj 


06(0.T] 


Then, combining (A.5), (A.18)-(A.22) with (A.17), we obtain that 
E 


sup |r 2 (t)|^ 
Oefo.T] 

< CE [ / 

Jo 


^b^x{t){Sx{t)^ -yUtf) 


1 

+ 0 / 9'^bxxx{t,9x{t) + {1 - 9)x'^{t),u{t))5x{t)^d9 

^ Jo 

+ [ {bx{t,9x{t) + {1 - 9)x^{t),u^{t)) 

Jo 


—bx{t, 9x{t) + (1 — 9)x'^{t), u{t)))Sx{t)d9 


dt 


+CE 


Jo 


<yxx{t){Sx{tf -2/i(t)^) Sax{t)riit)xEAt) 


1 C 

+ 0 / d^<J'xxxit,9x{t) + {1 - 9)x‘'{t),u{t))5x{t)^d9 
+ [ 9{axxit,9x{t) + {1 - 9)x''{t),u''{t)) 

JO 
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< CjE 

(A.23) +E 


-o-xx{t, dx{t) + (1 - d)x''{t), u{t)))Sx{t)'^dd 
E 


dt 


sup ISxitf-ylitff 

'-tG[0,T] 


sup \Sx{t)\^^ 

'-tG[0,T] 


sup 
'-te[o.T] 


-E 


sup \5x{t)\^^ £ 2 1 < Ce' 
= rn T'l J J 


'-tG[O.T] 


This proves the estimation for r 2 {-). 

Now, we prove the estimate for r 3 (-). 

Combining the variational equation (3.4), (3.5) and (3.6) with (A.15), we see that, 
r 3 (-) is the solution to the stochastic differential equation: 

drsit) = b^{t)r3{t) + \b^^{t){5x(tY - 

+ \b^xx{t){5x{tf - yl{tf) + Sb^{t)ri{t)xEAt) 

+ i fo ^^^xxxxit, 0x(t) + (1 - 9)x^(t), u{t))5x{tYd9 
+ fo 9(ba:x(t,9x(t) + (1 - 9)x^{t),u^{t)) 


(A.24) < 


dt 


—bxx{t, 9x{t) + (1 — 9)x^{t), u{t)))Sx{t)'^d9 
+ crx{t)r3{t) + ^a^^{t){Sx{t)'^ - l{tY) 

+ \(^xxx(t){5x{tf -yl{tf) + 5a^{t)r2{t)xEAt) 


+ 5 fo ^x(t) + (1 - 9)xAt), u{t))Sx{tyd9 

+ h fo ^^(^x:xx(t,9x(t) + (1 - 9)xAt),uAt)) 

—(Xxxxit, 9x{t) + (1 — 9)x'^{t), u(t)Adx(tAd9 dW (t), 

r3(0) = 0. 

Similar to (A. 18), we can prove that 


E 


'-^0 


9^bj;^j;Aty (^xit) + (1 - 9)x^(t), u(t))8x{tYd9 


dt 


(A.25) ^CE sup \Sx{t)f<^ <Ce^A 

Uelo.T] J 


Similar to (A. 19), we have 


E 


'-Jo 


9'^{<7xxx{t, 9x{t) + (1 - 9)xAt), uAt)) 
-ctxxxA, 9x{t) + (1 - 9)x^{t),u{t))]5x{tAd9 


dt 


(A.26) < CE 


\Sx{tAxEAt)\dt 


< CE 


sup \5x{t)\^^ £2 <Ce^^. 

tG[0,T] -I 


In a similar way, we have 


E 


'-Jo 


9^(7a;xxx{t,9x{t) + (1 - 9)x^{t),u{t))5x{tAd9 


dt 
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(A.27) < CE sup \5x{t)\'^ 

LtGlO.T] 


< 


and 


E 


d^{crxxxit,9x{t) + (1 - 9)x^{t),u^{t)) 
-(Txxx{t, 9x{t) + (1 - 9)x^{t),u{t))]5x{t)^d9 


dt 


(A.28) < C E( I \Sx{t)^XEeit)\^dt] <CE sup \Sx{t)\ 

' Ug[o.t] 


13/3 


£2 < Ce^^. 


On the other hand, by (A.l), (A.2), (A.5) and (A.23), we get that 
E 


sup \dx{tf-x{tff 
Oefo.T] 


= E 


sup (|r 2 (t)|^ • \Sx{t) + yl{t) + yUt)f) 
C rn T^l ^ / 


'-iG[0,T] 


VI 

sup 

k2(i)P^ 

)v(e[ 


^iG[0,T] 




sup \5x{t) + yl{t) + y^ 2 {t)\‘^^ 

te[o,T] 


(A.29) < Ce^^. 

Also, by (A.l), (A.5) and (A.9), we have 
E 


sup \6x^-yt{tff 
'-te[o,T] 


= E 


sup (|ri(t)|^ • \6x{tf +Sx{t)yl{t) +yl{tff) 

= rn T’l V / 


'-te[0,T] 


< 


Oefo.T] 

(A.30) < 


(e sup |ri(t)p^ ) • (e sup \6x{tf+6x{t)yl{t) + yf{t)'^\'^^ ) 

^ LfcrnT’l J/ V LjgjQjn] J/ 


Combining (A.25)-(A.30) with (3.2), we obtain that 
E 


sup |r 3 (t)|^ 
Oefo.T] 

rT 


< CE 


'-^0 


bxx{t){5x{tf 


+ -^hxxx{t){5x{tf - yl{tf) + Sbx{t)ri{t)xE,{t) 

+ - / 9^bxxx{t,9x{t) + {1 - 9)x^{t),u{t))6x{t)^d9 
6 Jo 

+ J 9(bxx{t,9x{t) + {1 - 9)x^{t),u^{t)) 

-bxx{t, 9x{t) + (1 - 9)x‘^{t),u{t))) Sx{t)^d9 


dt 


+CE 


-axx{t){Sx{t)^ - 7 ( 1 ) 2 ) 
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+ -^cr^^^{t){Sx{tf - yl{tf) + Sa^{t)r2it)xEAt) 

+ ^6a^^{t){Sx{tf - yi{tf)xEAt) 

1 

+ C / (^^<^xxxx{t,0x{t) + {1 - 9)x'^{t),u{t))Sx{t)‘'^d6 
6 Jo 

+ ^ J O‘^(^aj:xa:it,0x{t) + {1 - 0)x%t),U^{t)) 


(A.31) 


< c|e 

+E 

+E 

+E 


-(Txxxit, 0x{t) + (1 - 0)x%t),U 
+ E 


^d9 


dt 


sup \6x{t)^ 
'-te[o.T] 


sup \dx{tf-yUtff 
'-te[o,T] 


sup \ri{t)\^ +E sup \Sxitf-x{tff 

'-tefo.T] J ^te[o,T] 


sup \Sx{tf-yl{tff 
'-te[o.T] 


+ E 


sup |r 2 (<)|^ 
'-te[o,T] 


sup \6x{t)^ - ylitfl^ 
Ltefo.r] 


ef +£2/3 +£2^ 


} < Ce^^. 


This proves the estimate for r 3 (-). 


Step 3: We now estimate \\{Sx)^-y'^f^ g, \\{Sx)^-l^\\L,fi and ||(^x)4-(yf)'‘||^ g. 


llcxD,^ 

First, by (A.1)-(A.3), (A.5) and (A.31), we have 
E 


I oo,/9 ‘ 


sup \Sxitf-y{tff 
'-te[o.T] 


= E 


< 


sup (|r3(t)|'^ • |fe(t) + yl{t) + y 2 it) + yUt)^ 

‘-tG[0,T] ^ 

(e[ sup |r 3 (t)p'^l] " (e[ sup \6x{t)+yl{t)+y^{t)+y^g{t)\‘^p])' 

^ ‘-tG[0,T] ^ '-telO.T] 

M 


(A.32) < Ce^. 

Next, by (A.l), (A.2), (A.5) and (A.23), we get 
E 


sup |fe3-7(t)3|/3 

'-tG[0.T] 


= E 


< 


sup (|r 2 (t)|'^ • \5x{tf + Sx{t)x{t) + xitff'' 

.s[o.T] ^ ^ 

[e sup |r 2 (t)p^ ) ^ ®ap \dx{t)‘^ + Sx{t)xit) + ) 

V LtcftiT’i J/ V Ltg[o,T] J/ 


'-te[o,T] 


(A.33) < CeT. 

Finally, by (A.l), (A.5) and (A.9), we have 
E 


sup \Sx^-{yl)*f 

'-tG[0.T] 


= E 


sup (\n{t)\P • |fe(t) + yl{t)\P • \Sx{tf + ylitrf) 

-rn T1 V / 


'-tG[0.T] 
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< 


(e \ sup • flE [ sup \6xit)+ymM\' 

^ '-tG[0,T] ^ LtgjQj.] J/ 


(e 


sup \6x{tf+yl{tf 

'-te[o,T] 


M 


(A.34) <Ce^. 


dt 


Step 4 : Estimate for ||r 4 ||^ 

By (3.4)-(3.7) and (A.16), we obtain that 

dr4{t) = b^{t)r4{t) + ^b^x{t){Sx{t)'^ - T]{t)‘^) 

+ ^bxxx(t){6x{t)^ + Sbx(t)r2it)xE,(t) 

+ ^Sbxxit){6x{t)^ - yf(t)^)xB,(t) 

+ 5 fo ^^^^xx(t, Ox{t) + (1 - 9)x’^it),u{t))5x{t)'^d9 

"^^XXXX 

+ \ fg 9^(bxxx(t,9x(t) + (1 - 9)x^{t),u‘^{t)) 

-bxxxit, 9x{t) + (1 - 9)x^{t), u{t)))5x(tfd9 
+ Oxity^it) + \axx{t){dx{ty - rjity) 

+^<yxxx(t){Sx{ty - 7 ( 0 ^) + ^f^xit)r 3 (t)xE,{t) 

+ ^6axxit){6x{ty - x{tf)xEM 
+ \5axxx{t){5x{tf - yl{tf)xEyt) 

+ i fg 9^axxxx(t, 9x(t) + (1 - 9)x%t),u(t))dx(tyd9 

^^xxxxi^jVx (t) 

+ i fo ^^{^=oxxx{t,9x{t) + (1 - 9)x%t),uyt)) 

-crxxxx{t,9x{t) + (1 - 9)x‘^{t),u{t)))6x(tyd9 dW{t), 
t€[0,T], 
r4(0) = 0. 

By (A.34) and the conditions (C1)-(C2), we have 


E 


'-^0 


9^bxxxx{t, 9x{t) + (1 - 9)x^{t),u{t))Sx{tyd9 


< CE 


2 ^ ^xxxx 


dt 


+CE 


bx 


9^bxxxx{t)Sx(tyd9 - -bxxxx{,t)yyty 


^9 


dt 


dt 
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< CE 


sup \Sx{t)^^\dt 

'-tG[O.T] 


+ C'E 


sup \Sx{t)^-yl{t)y 

'-tG[O.T] 


(A.36) <Ce^. 
Similarly, 


E 


'-Jo 




d^(7xxxx{t, Ox{t) + (1 - 0)x'^{t),u{t))5x{t)'^d9 


xxxx 


dt 


(A.37) <Ce^. 

Next, similar to (A.19), we have 


E 


J j 9‘^{bx^^(t,ex{t) + {I - e)x'^{t),u'^{t)) 


-bxxxit, dx{t) + (1 - 6)x^[t),u 


^d6 


dt 


(A.38) ^CE / \6x{tfxEAt)\dt 


< CE 


sup \Sx(t)\^^ 
'-telo.T] 




and 


E 


J J 9^(^axxxx{t:0x{t) + (1 - 9)x^{t),u%t)) 


'-Jo Jo 


^xxxx {t, Ox{t) + (1 — 6)x^{t), 


Ae 


dt 


§_ 

' < CE 

sup \5x{t)\^^' 


Lie[0,T] J 


(A.39) ^CE / \Sx{tAxEAt)\ dt 

^JQ 


Finally, by (3.2) and (A.32)-(A.39), we obtain that 
E 


£2 < Ce 2 . 


sup |r 4 (t)|'^ 
Lteio.T] 

<ce\ [ 

^Jo 


^b^x{t){Sx{tA - r]{tf) + ^b^xx{t){Sx(tA - 7(0^) 
1 


+5b^(t)r2it)xEAt) + -5b^x{t){5x{tf - yl{tf)xEAt) 

+ F / + {I - 0)x^{t),u{t))5x{tAdO - 

6 Jo 24 

+ ^ J O‘^(bxxxit,0x(t) + {1 - 0)x^{t),u^{t)) 

-bxxx{t, 0x(t) + (1 - 0)xAt),u 


ACE 


‘-^0 


dt 


^crxx{t){Sx{tA - vAA) + 
1 


+SaAt)r3{t)xEAt) + -Sa^At){bxitA - l{tf)xEAt) 
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+ -^6aa,xx{t){Sx{tf - yl{tf)xEAt) 


g ^ ^XXXX {t, 9x(t) + (1 — 0)x^{t), u{t))Sx{t)'^d9 — ^ ^XXXX 
+ ^ 9x{t) + (1 - 9)x’'{t),u‘'(t)) 


< c|e 

+E 


^ xxxx (i, 9x{t) + (1 — 9)x’^{t), u 
+ E 


^d9 


dt 


sup \Sx{t)'^ — 
'-te[o.T] 


sup \6x{t)^ — 
'-te[o.T] 


sup \r 2 {t)f e/^+E sup \5x{tf - yl{tff 
Ltelo.T] J L(g[o.T] 


50 50 

+£2 + e 2 + E 


sup \Sx{tf-y{tff 

'-tG[0,T] 


+ E 


sup \Sx{t)^ — 

te[o,T] 


+E 


+E 


0 

£2 +E 


sup 
Ltelo.T] 


sup \5x{tf-yl{tff 
'-te[o.T] 


sup \5x{tf - 

LtGlO.T] 


£2 


P 5/3 5g 

£2 +£ 2 +£ 2 


5/3 

< Ce-. 


This completes the proof of Lemma 3.2. 

Appendix B. Proof of Proposition 3.4. First, by (3.4)-(3.7), we have 

i{t) = J bx{s)^{s) + ^bxxis){v{s),yis)) + ^&xxx(s)(7(s), 7(s), 7(s)) 

+ ^bxxxx{s){yl{s),yl{s),yl{s),yl{s)) + Sb{s)xEAs) 


+Sbx{s)-f{s)xEAs) + ^bbxx{s){yAs),yAs))xEAs) 


ds 


rt r 


y2/(s)C(s) + ^ ^xx {s){y{s),y{s)) + 

0 ^XXX (s)( 7 (s), 7 (s), 7 (s)) 

+ ^(^xxxx{s}\yl{s},yl{s} 

(B.l) +i<5CT,,,,(s)(7(s),7(s))x£;^(s) + i(5cr,^a:a/(s)(yKs),?/i(s),?/i(s))xis,(s) dW{s), 


0 [ 1 1 
VA) = I bxis)y{s) + 7ibxx{s){x{s),'y{s)) + ^bxxx{s){yl{s),yl{s),yl{s)) 


/o 


+56(s)X£;ys) + Sbxis)yl{s)xEAs) 


ds 


A \ 1 1 

+ [o-^(s)??(s) + 2 ^XX (s)( 7 (s), 7 (s)) + 

0 ^XXX {s){yl{s).yl{s).yl{s)) 

(B.2) +^cr(s)xB,(s) +5crx(s)7(s)Xi5ds) + ^<5(73,2,(s)(?/f(s),y^(s))xis,(s) dW{s), 

and 


7(i) = ^ ^x(s)7(s) + ^&/cx(s)(?/ns),?/i(s)) +<56(s)xij,(s) 


ds 
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+ 


/O 


Cr^(s)j(s) + -(T:z:x(s)(p!(s),pf(s)) 


(B.3) +^(^(s)xbAs) + Sa^(s)pf(s)xsjs) dW(s). 

Then, using the formula (2.1) in Lemma 2.1, we obtain that 
E (h,(x(T)),^(T)) = -E (pi(T),aT)) 


= -E 

1 


1 


. g + - {qi{t),(Jxxx{t){l{t),x{t),l{t))) 

+ ^ (Pi(i)> bx^xxx{t){yl[t),yl{t),yl{t),yl{t))) 

+ cTxxxx {t){yl{t),ylit),yt{t),yf{t))) 

+ {fx{t),^{t)) + {pi{t),Sb{t))xEAt) + {Qiit),ba{t)) xsAt) 

+ {pi{t),Sbx:{t)x{t)) xeM + {qiit).bax{t)y{t)) xeM 
+ \ {pi (t ): bbxx(t) {yl(t ), yl(t ))) XE, {t) 

(B.4) +^{qi{t),Saxx{t){yl{t),yl{t)))xEAt) dt + o{e^), (e0+), 


E {hxx{x{T))y{T)MT)) = -E {p2{T)y{T),y{T)) 


pT , 


= -E {P2{t)b^xit){x{t),-f{t)) i {P2it)y{t),b^xit){'j{t),j{t))} 

1 / , , , ,/ , , , 1 


2 {q2(t)axx(t){x{t),"/(t)) ,y{t)) + - {q2{t)yit), axx{t){x(t),j(t))) 

{P 2 {t)b:xxx{t) {yl{t),yl{t), yl{t )), y{t)) 


1 

6 
1 

6 
1 

6 

1 

*6 

- {P2{t)5b{t),y{t)) xeM + {P2{t)v{t),6b{t))xEAt) 

- {q 2 {t)Sa{t),y{t)) xeA*) + {q 2 {t)y{t), Sa{t)) xeM 

■ {P 2 {t)Sb^ {t)yl (t), yit)) xe, (t) + {p 2 6 bx {t)yl {t)) xe, {t) 

■ {q 2 {t)Sax{t)-f{t),y{t)) xeM + {q 2 {t)y{t), 6 crx{t)-f{t)) XeM 


{P2 {t)y{t) , bxxx (t) {yl (t) , yl (t ), yl {t ))) 
{q2 {t)axxx (t) {yl (t), yl(t ), yl (t)), y{t) ) 
(92 , ax:xx {t){yl (t ), yl (t), yl (t ))) 


+ {p2{t)ax{t)y{t), ^crxx{t){j{t),-f{t)) + ^crxxx{t){yl{t),yM,yl{t))) 

+ {P2{t)[^axx{t){-f{t),^{t)) + ^crxxx{t){yM,yM,yM)],^x{t)y{t)) 
+ {p2 (i )crx {t)y{t) ,5cj{t)+5(7X {M{t) )XE, (<) 
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+ \{p-i (Oo-xx it) {x{t), 'y(t)), (t) j(t))} 

+ ^(P2(t)o-xx(t)(j(t),'y(t)), Sa(t))xEAt) 

+ ^(P2 > c^xx(<) (lit), 'y{t)))xE, {t) 

+ {p2it){Sa{t) +Sa^{t)x{t)),S(^{t) + Sa^it)x{t))xEAt) 

+^{p2{t)Sa:,At){yl{t),yl{t))A<^it))xE, (t) 

+ ^{P 2 {t)Sa{t), 5(J^^{t){yl{t ), yl(t)))xE, A) 

(B.5) - {'Ha:x{t)y(t),y{t)) dt + o{sA (e 0+), 


= -E 


P3(T)(7(T),7(T),7(T)) 


/ixxx(S(T))(7(T),7(r),7(r)) 

PsA) (^^xx( 0 ( 2/1 2/1 (0) + Sb{t)xEe (0> 7(0) 7 ( 0 ) 

+P3 (2) ( 7 ( 0 , ^^xx(t) (2/1 (0 ) 2/1 (0) + Sb{t)xE, (0 ) 7 ( 0 ) 


= -E 


+P3 (t) (7(0) 7(0) ^^xx (2) ( 2/1 (2), 2/!(2)) + Sb{t)xE, (2)) 

(p2(2)&xx(2)(7(2),7(0))7(0) - ^ (p2(07(0)&xx(2)(7(2),7(0)) 
(92(0o-xx(2)(7(0)7(2)))7(2)) - ^ ( 92 ( 2 ) 7 ( 2 )) crxx(2)( 7 ( 2 ), 7(0)) 
(P2(2)crxx(2)(7(2),7(0),crx(2)7(2)) - ^ (p2(2)crx(2)7(2), crxx(0(7(0) 7(0)) 
+ 93 ( 2 ) (icr^x(2) ( 2 /f (2)) 2/1 (2)) + i5cr(0x£;, (2), 7 ( 2 )) 7(2)) 

+ 93 ( 0 ( 7 ( 2 )) ^f^xx(2) ( 2 / 1 ( 2 ), 2/1 (0) +^o-(2)XisOO)7(2)) 

+93(2) ( 7 ( 2 )) 7 ( 2 ), (2) ( 2/1 (2), 2/1 (2)) + 6 a{t)xE, (2)) 

+ ^P3( 2 ) (ci,x ( 2 ) 7 ( 2 ), o-xx ( 2 ) ( 2 /f ( 2 )) yl ( 2 )) , 7 ( 2 )) 

+ ^P3(2) (c1x(2)7(2), lit), < 7 ^^ (2)(i/f (2), 2/1 (2))) 

+ ^P3(0 ( 7 ( 2 )) crx(2)7(2),cr,,,r(0(2/i(2), 2 / 1 ( 2 ))) 

+ ^P3( 2 ) (ci,cx ( 2 ) ( 2 /f ( 2 ), yl ( 2 )), CTx ( 2 ) 7 ( 2 )) 7 ( 2 )) 

+ ^P3(0(c^xx(2)(2/f(2),2/f(0))7(2),o-x(2)7(2)) 

+ ^P 3 ( 2 ) ( 7 ( 2 )) CTxx (2) ( 2 /?(2)) 2/1 (2)), o-x ( 2 ) 7 ( 2 )) 
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+P3 (t) (cr^ , 5(j{t), j{t)j XE, (t) + P3 (t) j{t), S(7{t)j XE, {t) 

+P3{t) (lit), Sa{t)^ xe, (t) + P3{t) (6a{t), (<)7(0: l(t)) Xe, {t) 

+P3 {t) {6a{t), 7(i) , (t)7(0) Xe, (t) + p^ (<) Sa{t), {t)j{t)jxE, {t) 

+P3{t) {Sa{t), Scr(t),'y(t)'j xe, (<) + Psit) (6a{t), j{t),6a{t)^ xe, (t) 

+P3{t)(lit),Sa{t),6a{t)^XEAt) 

+P3 {t) (Sa{t), Sa^, {t)yl (t), xe, (t) + ps {t) (Sa{t), x{t), 5a^ {t)yl (t)) xe, (t) 

+P3{t) (lit),Sait),Sa:^ it)yl(t)(j xe, {t) + P3[t) (Sa^^it)yl(t),Scr{t),iit)^ xe, (t) 
+P3(t) (Sa:^it)ylit),iit),Sait)^ xe, it) + P3it) (lit), Sa^it)yl (i), (5cr(t)) xe, it) 
(B.6)-nxxxit)iiit),iit),iit)) dt + oie^), (e^0+), 
and 

E [h,^,^ixiT))iyliT),yliT), yHT), yf (T)) 

= -E \p,iT)iyliT),yliT),yliT),yliT)) 


pT ^ 


= -E 


Piit) iSait),Sait), yl it), ylit))xE, it) 
+P4 it) iSait), yl it) ,Sait),yl it))xE, it) 

+P4it) iSait), yl it), yl it), Sait)) xe, it) 

+Piit) (ylit), Sait), Sait), yl it))xE, it) 

+Piit) (yi it), Sait), yl it), Sait)) xe, it) 

+Piit) iyl it), yl it), Sait), Sait))xE, it) 

-2p3it) (h,^,xit) {ylit), yl it)), yl it), yl (i)) 

-2p3 it) (yl it), 6^^ it) {yl it), yl it)), yl (t)) 

-2P3 it) (yl it), yl it), 6^^ it) {yl it), yl (t))) 
-2q3it) (ax:xit) {yl it), yl it)), yl it), yl (t)) 

-2(73 (i) (yl it), cTxx it) {yl it), yl it)), yl it)(j 
-2(73 it) (yl it), yl it), a,xx it) {yl it), yl it ))) 
-2p3it) (ax, it)ylit), aXX it) {ylit), yl it)), yl (i)) 
-2p3 it) (ax it)yl it), yl it), axx it) {yl it), yl (t))) 
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(B.7) 


-2p3(t) (^yl(t ), cr^ (t)yl(t ), (<) {yl(t ), yl 

-2p3(t) (^aa:a:(t) (?/i {t), yf {t)), it)yl (t), yf (i)) 
- 2 p 3 {t) (t) {yl(t), yl{t)), yl (i), {t)yl (t)) 

-2p3 (t) (^yl (t ), {t) {yl {t ), (t)) , {fyyl {t)j 

-2 {p 2 it)b^xx it) {yl {t), yl [t ), yl {t )), yl (t)) 

-2 {p 2 (t)yl (t ), bxxx{t) {yl(t ), yl (t ), yf (t ))) 

-2 (ya (i)crx (i)yi (i), ctxxx (t) {yl (t), yl (i), yl (t ))) 

-2 {p 2 {t)axxx (t) {yl (<), yf (i), yl (t )), o-x (<)yi (0) 
-2 (ya(i)yf (0, ^xxx{t) {yl{t), yl(t), yl (t))) 

-2 (ya(i)o-xxx(<)(yf (i), yl{t), yl (i)), yl{t)) 

-3 {p 2 {t)axx it) {yl it), yl it )), Uxx it) (yi it ), yl it))) 


-Ux 


<^it){ylit),ylit),ylit),ylit)) dt + oie^), (e 0 


Substituting (B.4)-(B.7) into the Taylor expansion (3.8), we obtain that 
J(m^) — Jiu) 


rT , 


= -E 


-Sfit)xE,it) - 5fxit)lit)XEAt) - \5fxxit)iylit),ylit))xEAt) 


+ ipiit),Sbit))xEAt) + iqiit),Sait)) XE.it) 

+ iPiit), Sbxit)xit)) XE.it) + {qiit),Saxit)xit)) XE.it) 

+ ^{piit)Abxxit)iylit),ylit)))xEAt) 

+ ^{yiit), ScTxx it) iyl it), yl it ))) XE, it) 

+ ^ {P2it)Sbit),xit)) XE.it) + ^ iP2it)xit),Shit))xEAt) 

+ ^ {q2it)Sait),xit)) XE.it) + ^ iq2it)xit),Sait)) XE.it) 


1 


1 


, ^ ip 2 it)Sbxit)ylit),ylit)) xeAA + ^ ip2it)ylit),5bxit)ylit)) xeAA 
+ ^ iq2it)daxit)ylit),ylit))xEAt) + ^ iq2it)ylit),5(Jxit)ylit)) xeAA 
+ \{P2it)(yxit)lit),5ait))xEAt) + \{P2it)5ait),axit)xit))xEAt) 


{P2 it)(Jx it)yl it) ,S(Txit)yl it))xEe it) 

{P2it)S( 7 xit)ylit ), axit)ylit))xE, it) 
{P2it)axxit) {ylit),ylit )), Sait))xE, it) 
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+ ^ (P2 (t)< 5 cr (<), (<) (2/1 W, 2/1 W ) ) XBe W 

+ ^{P2{t)Scr{t), Sa{t))xEAt) + ^{P2{t)6a{t),Scrx{th{t))xEAt) 

+ ^{P2(t)Saxithit),Scrit))xEAt) + ^{P2it)Saxit)yAt)Acrx(t)yl(t))xEA't) 

+ ^ {P2 (t)Saxx (t) {yl(t), yl (2)), 5 a{t))xE, (t) 

+ ^{P2(t)Sa{t), 6axx(t){yl ( 2 ), yl{t)))xE,(t) 

+ ^P 3 it){Sb{t),yl(t),yl{t))xEAt) + ^P 3 (t){ylit), 6bit),yl{t))xEAt) 

+ ^P3{t) {yl ( 2 ), yl ( 2 ), Sb{t)) xe, A) + ^ 93 ( 2 ) {Sa{t), yl ( 2 ), yl{t))xE, A) 

+ ^93 ( 2 ) (2/1 if). ^cr( 0 , Vl f))XE, f) + ^q 3 it) (yl it), yl it), 5 cr( 2 )) xe, A) 

+ ^P 3 it) (o-x (2)2/1 ( 2 ) fo-(t),yl ( 2 )) XE, it) + ^P 3 it) (cr^ it)yl it), yl ( 2 ), 5 cr( 2 )) xe, f) 
+ ^P3 it) (2/1 (2), o-x (2)1/1 (2), <5ct(2)) xe, it) + ^P3 it) {5a f), Ux it)yl it), yl (2)) xe, f) 

+ ^P 3 it) (bo-it), yl it), ax it)yl (2)) xe, it) + ^P3 it) (^yl it) ,Sa(t),ax it)yl (2)) xe, f) 
+ ^P3(2) (Saf), Sa{t), jlt)^ xe, it) + ^P3it) (Saf), 7(2), ( 5 ct( 2 )) XE^f) 


^P3(2) (if), Sait), Sa{t)^ xe, it) 

ip3(2) ((5cr(2), Saxit)ylit), yf (2)) xe, it) + ^P3it) (Saf), yl(t), 5axit)yl 
\p3it)(^ylit),Saf),5axit)ylit)'^XEAt) + ^P3it){5axit)ylit),5ait),yl 
ip3(2) (Saxi^ylf), ylf),5a{t)'^ xe, it) + ^P3it) (vUt), Saxi^ylf), So- 
pft) {Sait), Sait), yl (2), yl it))xE, it) 

Pi it) {Sait), yl (2) ,Saf),yl it))xE, it) 

Pi it) {Sait), yl (2), yl (2) ,5a{t)) xe, it) 

Pft) {yl (2), 5a{t),5a{t), yl (2))xis, (2) 

Pi (2) ( 2/1 (2) ,5a{t),yl (2) ,5a{t)) xe, (2) 

P4it){ylit),ylit),5ait),5a{t))xEAt)]dt + of^), f 0+) 


XEft) 

XEft) 

XEft) 


24 

1 

T4 

1 

T4 

1 

T4 

1 

T4 

1 

T4 


/■T , 


= -E 


H( 2 ,x( 2 ),m( 2 )) + (S( 2 ,x( 2 ), 11 ( 2 )), 7 ( 2 )) 


+ 2 (T(2,a;(2),ii(2))yf(2),y^(2))Jxi3,(2)d2 + o(£:2), f 0+). 
This proves (3.11), and completes the proof of Proposition 3.4. 
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